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ABSTRACT 


In  the  FORCEnet  Functional  Concept  document  published  by  the  Chief  of  Naval 
Operations  and  the  Commandant  of  the  Marine  Corps,  the  leaders  of  the  US  Naval  Forces 
called  for  the  development  of  “adaptive,  distributed  networks  of  commanders,  staffs, 
operating  units,  supporting  organizations,  sensors,  weapons  and  other  equipment 
interacting  with  one  another  on  an  underlying  infrastructure,  as  well  as  the  associated 
command  and  control  policies,  concepts,  organizations...  to  allow  them  to  interact.” 
Posed  to  invest  in  the  development  of  the  FORCEnet  architecture,  the  Navy  and  Marine 
Corps  require  a  means  of  analysis  to  determine  the  value  of  infonnation  technologies 
prior  to  development  and  acquisition.  The  Knowledge  Value  Added  (KVA)  methodology 
can  provide  the  decision  makers  with  quantitative  tools  to  make  informed  and  accurate 
decisions  in  the  acquisitions  process  of  information  technologies  within  the  FORCEnet 
Functional  Concept  framework.  Historically,  these  decisions  were  based  on  costs, 
schedule,  and  capabilities,  with  the  emphasis  on  cost. 

A  Proof  of  Concept  analyzing  the  Joint  Forces  Maritime  Component  Command 
Planning  Process  was  developed  to  demonstrate  the  utility  of  the  KVA  method.  This 
analysis  demonstrates  the  current  inefficiencies  within  the  process  and  the  potential  value 
of  notional  information  technologies  that  could  be  developed  to  support  the  planning 
process. 


v 


THIS  PAGE  INTENTIONALLY  LEFT  BLANK 


vi 


TABLE  OF  CONTENTS 


I.  INTRODUCTION . 1 

A.  BACKGROUND . 1 

B.  PURPOSE . 1 

C.  RESEARCH  OBJECTIVES . 2 

D.  RESEARCH  QUESTION . 3 

E.  METHODOLOGY . 3 

F.  SCOPE . 3 

G.  ORGANIZATION  OF  THESIS . 4 

II.  LITERATURE  REVIEW . 5 

A.  FORCENET . 5 

1.  The  FORCEnet  Vision . 5 

2.  FORCEnet  and  Command  and  Control . 5 

B.  THE  JFMCC  PLANNING  PROCESS . 7 

1.  Organization  of  the  JFMCC  Staff . 7 

2.  Future  Operations  Cell . 10 

3.  The  JFMCC  Planning  Process . 10 

C.  DECISION  SUPPORT  SYSTEMS  TO  AID  THE  PLANNING 

PROCESS . 14 

1.  CoRaven . 15 

2.  Weasel . 16 

3.  Fox . 17 

D.  RETURN  ON  INVESTMENT . 17 

1.  Return  on  Investment  Defined . 17 

2.  Non-Profit  ROI . 18 

3.  Information  Technology  ROI . 20 

a.  Current  Approaches . 20 

b.  DoD  Information  Technology  Investments . 22 

III.  THE  KNOWLEDGE  VALUE-ADDED  METHODOLOGY . 23 

A.  THE  VALUE  PROBLEM . 23 

B.  THE  KNOWLEDGE  VALUE-ADDED  METHODOLOGY . 23 

1.  KVA  Theory . 24 

2.  Identification  of  Core  Processes . 25 

3.  Approaches  to  Measuring  Knowledge . 25 

a.  The  Learning  Time  Approach . 26 

h.  Reliability  of  Learning  Time  Estimation . 26 

IV.  METHODOLOGY  PROOF  OF  CONCEPT . 27 

A.  INTRODUCTION . 27 

B.  SECOND  FLEET  PLANNING  PROCESS  IN  T W  05 . 28 

C.  DATA  COLLECTION  METHODOLOGY . 3 1 

1.  Assumptions . 31 

a.  Length  of  Sample  Period . 31 

vii 


b.  Cost  of  Human  Capital . 32 

c.  Proxy  Revenue  Assumptions . 32 

D.  KVA  ANALYSIS  OF  THE  “AS-IS”  PLANNING  PROCESS . 34 

1.  Determining  the  Revenue  Generated  by  Subprocesses . 34 

2.  Determining  Process  and  Subprocess  Costs . 38 

3.  Determining  the  ROI  for  the  Process  and  Subprocesses . 39 

E.  “TO-BE”  PLANNING  PROCESS . 39 

1.  The  Cost  of  IT . 39 

2.  The  Reengineered  Planning  Process . 41 

F.  KVA  ANALYSIS  OF  THE  “TO-BE”  PROCESS . 42 

1.  Determining  the  Value  of  the  “To-Be”  Process  IT . 42 

2.  Determining  “To-Be”  Process  and  Subprocess  Costs . 43 

3.  Determining  ROI  for  “To-Be”  Process  and  Subprocess . 45 

4.  Determining  ROI  of  Information  Technology . 45 

G.  COMPARISION  OF  THE  “AS-IS”  AND  “TO-BE”  PROCESSES . 46 

V.  CONCLUSIONS  AND  RECOMMENDATIONS . 49 

A.  RESEARCH  LIMITATIONS . 49 

B.  RESEARCH  QUESTIONS . 49 

1.  Planning  Time . 50 

2.  Cost  Savings . 50 

3.  Improved  ROI . 50 

C.  RECOMMENDATIONS  TO  THE  US  NAVY . 50 

LIST  OF  REFERENCES . 53 

INITIAL  DISTRIBUTION  LIST . 57 


viii 


LIST  OF  FIGURES 


Figure  1 .  Organization  of  the  JFMCC  Staff  (From  NWDC,  2004) . 9 

Figure  2.  Organization  of  the  Future  Operations  Cell  (From  NWDC,  2004) . 10 

Figure  3.  The  JFMCC  Planning  Process  (From  NWDC,  2004) . 12 

Figure  4.  The  Intelligence  Collection  and  Planning  Cycle  (From  Hayes,  et  ah,  2002)  ..15 

Figure  5.  A  System  Diagram  of  Weasel  Components  (From  Hayes,  et  ah,  2002) . 16 

Figure  6.  Fundamental  Assumptions  of  KVA  (From  Housel  &  Bell,  2001) . 24 

Figure  7.  Execution  Time  Comparison  of  “As-Is”  and  “To-Be”  Process . 46 

Figure  8.  Cost  Comparison  of  the  “As-Is”  and  “To-Be”  Process . 47 

Figure  9.  ROI  Comparison  of  the  “As-Is”  and  “To-Be”  Planning  Process . 48 


IX 


THIS  PAGE  INTENTIONALLY  LEFT  BLANK 


x 


LIST  OF  TABLES 


Table  1.  Common  Approaches  to  Measuring  the  Return  on  IT  (  From  Pavlou,  P.,  et 

ah,  2005) . 21 

Table  2.  Three  Approaches  to  KVA  (From  Housel  &  Bell,  2001) . 25 

Table  3.  Normalized  Learning  Time  Survey  Results . 35 

Table  4.  Value  Attributed  to  “As-Is”  Subprocesses  and  Planning  Process . 37 

Table  5.  Manpower  Costs  of  “As-Is”  Subprocesses  and  Planning  Process . 38 

Table  6.  ROI  of  “As-Is”  Subprocesses  and  the  Planning  Process . 39 

Table  7.  Value  Attributed  to  IT  in  “To-Be”  Process . 43 

Table  8.  Manpower  and  IT  Costs  Associated  with  “To-Be”  Planning  Process . 44 

Table  9.  ROI  of  “To-Be”  Process  and  Subprocesses . 45 


THIS  PAGE  INTENTIONALLY  LEFT  BLANK 


ACKNOWLEDGMENTS 


I  would  like  to  express  my  sincere  gratitude  to  Dr.  Thomas  Housel  and  Mr.  Glenn 
Cook  for  the  effort  and  trust  they  granted  to  me  in  this  research.  I  also  offer  my  thanks  to 
Dr.  Shelley  Gallup  and  Mr.  Jack  Jensen  who  provided  further  motivation  by  providing 
insight  into  the  potential  value  of  this  research  to  the  Navy  and  Marine  Corps.  I  also 
would  like  to  thank  the  many  men  and  women  of  Naval  Networks  Warfare  Command, 
Second  Fleet,  the  Iwo  Jima  Expeditionary  Strike  Group,  and  the  24th  Marine 
Expeditionary  Unit  who  took  time  from  their  own  schedules  to  provide  the  infonnation 
used  in  this  research. 

Finally,  to  my  wife  and  best  friend,  Amy,  I  offer  my  deepest  love  and  gratitude. 
Through  her  continuous  support,  understanding,  and  encouragement  in  this  endeavor  and 
in  all  other  aspects  of  our  lives  I  find  the  true  value  in  all  things. 


THIS  PAGE  INTENTIONALLY  LEFT  BLANK 


xiv 


I.  INTRODUCTION 


A.  BACKGROUND 

The  Department  of  Defense,  along  with  all  other  government  agencies,  operates  in 
an  environment  of  competition  for  limited  funding  resources.  In  this  environment,  the 
military  services  must  concurrently  prosecute  the  missions  assigned  for  the  defense  of  the 
nation  and  its  interests,  while  looking  toward  the  future  to  develop  the  systems  that  will  be 
applied  to  the  nation’s  defense  in  the  years  to  come.  Through  decisions  made  today,  the 
systems  that  support  the  nations  forces  will  be  conceptualized,  developed,  and  deployed  to 
meet  the  future  threats  to  our  nation.  To  continue  to  thrive  in  this  environment  of  limited 
budgets,  the  United  States  Navy  must  determine  the  future  capabilities  of  the  force  and  be 
able  to  soundly  present  the  reasoning  objectively  to  decision  makers  in  the  Department  of 
Defense  and  Congress. 

It  is  estimated  by  experts  at  the  Government  Electronics  and  Information 
Technology  Association  that  the  Department  of  Defense  will  spend  approximately  $702 
billion  on  C4ISR  research  projects  and  procurement  in  the  decade  spanning  from  2006  to 
2016,  with  information  technologies  accounting  for  an  estimated  $30.1  billion  in  2006. 1 
With  such  a  large  sum  of  tax  dollars  being  invested  in  information  technologies,  it  is 
imperative  that  the  decision  makers  that  allocate  funds  invest  in  the  right  systems  that  will 
prove  most  beneficial  to  the  military  services  and  the  national  defense. 

B.  PURPOSE 

In  the  Department  of  the  Navy  Publication  “FORCEnet:  A  Functional  Concept  for 
the  21st  Century”  the  leaders  of  the  United  States  Navy  and  Marine  Corps  propose 
FORCEnet  as  a  capability  which  will  “empower  Sailors  and  Marines  at  all  levels  to  execute 
more  effective  decision-making  at  an  increased  operational  tempo”  resulting  in  greater 


1  John  Keller,  Reductions  Eyed  for  Battle  Management  and  Information  Technology  Spending.  Military 
&  Aerospace  Electronics.  January  2006.  Retrieved  March  2006  from 

http://mae.pennnet.com/Articles/Article  Display. cfm?Section=ARTCL&ARTICLE  ID=245872&VERSION 
NUM=2&p=32  “  “  ""  . 
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effectiveness  and  mission  accomplishment.2  The  FORCEnet  concept  is  to  serve  as  the 
catalyst  for  naval  transformation  and  revolutionizing  naval  command  and  control.  To  realize 
FORCEnet,  the  US  Navy  and  Marine  Corps  are  poised  to  invest  a  great  deal  of  resources  to 
develop  and  adopt  the  technologies  that  will  make  it  possible. 

With  the  publication  of  Naval  Warfare  Development  Command  (NWDC) 
TACMEMO  3-32-03  “Joint  Force  Maritime  Component  Commander  (JFMCC)  Planning 
and  Execution”  in  June  2004,  the  Navy,  for  the  first  time,  formalized  into  doctrine  the 
planning  process  to  be  executed  by  its  commanders  at  sea.  The  planning  process  as 
executed  today  is  very  manpower  intensive  and  is  largely  unsupported  by  infonnation 
technology  (IT)  systems.  This  research  will  address  the  benefits  of  the  development  of  and 
fielding  of  IT  systems  to  support  the  crisis  action  planning  process  of  the  US  Navy. 

A  case  study,  observed  during  the  Trident  Warrior  2005  experiment,  will  serve  as  a 
baseline  “as-is”  of  the  planning  process.  It  will  provide  measures  by  which  the 
incorporation  of  IT  systems  can  be  evaluated.  In  this  research,  the  Knowledge  Value  Added 
(KVA)  methodology  will  be  used  to  compare  the  “as-is”  process  to  the  processes  where 
notional  IT  systems  are  incorporated.  The  results  of  these  comparisons  will  be  provided  to 
the  US  Navy  as  recommendations  for  or  against  the  development  of  IT  systems  to  aid  the 
planning  process. 

C.  RESEARCH  OBJECTIVES 

The  objective  of  this  research  is  to  analyze  the  potential  benefits  of  the  development 
of  FORCEnet  IT  systems  to  assist  decision-making  in  turbulent  environments.  Specifically, 
this  research  will  evaluate  the  JFMCC  Planning  Process  as  conducted  during  crisis  action 
planning  in  Trident  Warrior  2005.  Prior  to  providing  recommendations  for  future  systems,  a 
baseline  analysis  of  the  JFMCC  planning  process  must  be  conducted  to  establish  the  current 
state  of  the  process.  With  the  baseline  established,  a  future  IT  system  can  be  evaluated 
within  the  process  and  the  analysis  of  its  impact  conducted. 


2  Department  of  the  Navy  Publication,  (2005)  “FORCEnet:  A  Functional  Concept  for  the  21st  Century,” 
Introduction  by  Clark,  V.  Chief  of  Naval  Operations  and  Hagee,  M.  Commandant  of  the  Marine  Corps, 
Washington:  Department  of  the  Navy. 
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D.  RESEARCH  QUESTION 

The  development  of  IT  systems  is  a  high  risk  endeavor.  According  to  David  Haas, 
writing  in  the  Defense  Acquisitions  University  periodical  Program  Manager,  the  failure  rate 
of  IT  acquisitions  programs  is  as  high  as  83%3.  This  high  failure  rate  coupled  with  the  vast 
sums  of  money  allocated  to  IT  systems  requires  that  objective  and  quantifiable  information 
be  provided  to  decision  makers  so  that  the  benefits  of  such  programs  are  maximized  in  the 
processes  they  support. 

The  primary  question  of  this  thesis  is:  What  is  the  value  of  FORCEnet  IT  systems 
when  employed  in  turbulent  decision-making  environments,  specifically  the  JFMCC 
planning  process?  The  answer  to  this  question  will  provide  the  decision  maker  a  solid  basis 
for  selecting  where  the  funds  of  today  should  be  invested  to  provide  the  greatest  return  for 
the  Navy  of  the  future. 

E.  METHODOLOGY 

This  thesis  will  model  the  JFMCC  planning  process  as  conducted  during  the 
experiment  Trident  Warrior  2005  and  establish  the  baseline  analysis  of  the  planning  process 
using  the  KVA  methodology.  In  conducting  the  KVA  analysis,  the  return  on  investment  for 
each  of  subprocesses  and  the  planning  process  as  a  whole  will  be  determined.  With  the 
return  on  investment  baseline  established,  a  hypothetical  scenario  with  notional  FORCEnet 
technologies  will  be  evaluated  to  determine  the  impact  of  the  IT  systems  within  the  JFMCC 
planning  process. 

F.  SCOPE 

The  JFMCC  Planning  Process  formalized  in  the  Navy  Warfare  Development 
Command  TACMEMO  3-32-03  is  specific  to  crisis  action  planning  at  the  operational  and 
tactical  levels  of  warfare.  However,  it  is  not  specific  to  the  US  Navy.  The  JFMCC  Planning 
Process  is  in  concert  with  the  US  Army  and  US  Marine  Corps  planning  processes. 
Therefore,  although  this  thesis  uses  the  JFMCC  planning  process  for  analysis,  the  results  of 

3  David  Haas,  Government-wide  Information  Technology  (IT)  Acquisitions.  Program  Manager.  12.  May 
June  2003.  Retrieved  April  2006  from  http://www.dau.mil/pubs/pm/pmpdf03/mav/has-m-i03.pdf 
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this  thesis  can  provide  insight  to  both  the  Anny  and  Marine  Corps  decision  makers  for  the 
acquisition  of  new  IT  systems  to  support  the  planning  process  of  their  respective  service. 


G.  ORGANIZATION  OF  THESIS 

This  thesis  will  be  organized  in  the  following  manner: 

Chapter  I  will  provide  an  overview  of  this  research  project  and  will  present  to  the 
reader  the  primary  objectives  and  questions  on  which  it  will  focus.  The  research 
methodology  and  the  scope  of  this  thesis  will  be  described. 

Chapter  II  will  provide  the  necessary  information  for  understanding  the  JFMCC 
planning  process  as  described  in  NWDC  TACMEMO  3-32-03  that  serves  as  the  basis  for 
the  “as-is”  model  of  the  planning  process.  The  topics  covered  in  this  chapter  include  the 
FORCEnet  Functional  Concept,  the  JFMCC  Planning  Process,  a  brief  description  of 
notional  technologies  to  support  the  military  planning,  Return  on  Investment,  and  IT 
Acquisitions  for  the  DoD. 

Chapter  III  discusses  the  Knowledge  Value  Added  (KVA)  methodology  in  detail  to 
enhance  the  readers  understanding  of  the  knowledge-based  return  on  investment  analysis 
from  which  this  thesis  draws  its  conclusions  and  recommendations. 

Chapter  IV  will  provide  the  analysis  of  the  “as-is”  planning  process  and  will  make 
prospective  analysis  of  notional  planning  processes  that  incorporate  IT  systems  to  aid  the 
human  in  accomplishing  the  planning. 

Chapter  V  summarized  the  research  presented  and  will  state  conclusions  and  provide 
recommendations  to  the  Navy  and  the  Department  of  Defense  as  a  whole  regarding  the 
development  of  IT  systems  to  aid  the  planning  process. 
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II.  LITERATURE  REVIEW 


A.  FORCENET 

The  FORCEnet  concept  will  serve  as  the  primary  driver  of  the  transfonnation  of  the 
command  and  control  of  naval  forces.  FORCEnet  ’’...describes  the  principles,  defines  the 
capabilities,  and  reaffirms  the  necessity  of  co-evolving  information  technology  with 
organization,  process,  and  doctrine.”4 

1.  The  FORCEnet  Vision 

In  the  FORCEnet  Functional  Concept  document  published  by  the  Chief  of  Naval 
Operations  and  the  Commandant  of  the  Marine  Corps,  the  leaders  of  the  US  Naval  Forces 
called  for  the  development  of  “adaptive,  distributed  networks  of  commanders,  staffs, 
operating  units,  supporting  organizations,  sensors,  weapons  and  other  equipment  interacting 
with  one  another  on  an  underlying  infrastructure,  as  well  as  the  associated  command  and 
control  policies,  concepts,  organizations...  to  allow  them  to  interact.”  The  objective  of 
these  networks  is  to  provide  warfighting  commanders  with  the  ability  to  make  better, 
timelier  decisions  than  they  currently  can.5  The  various  information  technology  systems 
which  will  support  the  networking  of  the  above  named  facets  of  the  forces  are  currently 
being  investigated.  However,  each  emergent  technology  does  not  hold  equal  value  when 
placed  in  the  context  of  the  process  it  will  support.  For  the  functional  concept  to  be 
realized,  the  infonnation  technologies  that  are  being  adapted  must  be  analyzed  individually 
and  as  a  system  of  systems  to  assure  that  they  are  adding  value  to  the  processes 
accomplished  by  the  warfighting  commanders  and  staffs. 

2.  FORCEnet  and  Command  and  Control 

Command  and  control  is  the  means  and  methods  by  which  a  commander 
recognizes  that  needs  to  be  done  in  any  situation  and  sees  that  appropriate 
actions  are  taken...  It  ranges  from  the  intuitive  judgments  that  only  skilled 
and  experienced  people  can  perform  to  the  precise,  instantaneous 
determinations  that  only  automation  can  perform.6 


4  Department  of  the  Navy  Publication,  (2005)  “FORCEnet:  A  Functional  Concept  for  the  21st  Century,” 
Introduction  by  Clark,  V.  Chief  of  Naval  Operations  and  Flagee,  M.  Commandant  of  the  Marine  Corps, 
Washington:  Department  of  the  Navy. 

5  Ibid.,  p.  1. 

6  Ibid.,  pp.  6-7. 
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Command  and  control  is  not  merely  a  human  function;  for  example  the  terminal  guidance  of 
a  missile  provided  by  its  onboard  computer  and  Global  Positioning  System  receiver  is  a 
form  of  command  and  control.  For  real-time  command  and  control  of  this  sort,  a  human 
decision  maker  can  not  process  inputs  in  a  timely  manner  to  affect  the  course  of  flight 
appropriately.  Other  forms  of  command  and  control  are  more  appropriate  for  human 
decision  makers.  The  employment  of  military  forces  through  the  combined  use  of  strategy, 
operations,  and  tactics  is  a  form  of  command  and  control  in  which  the  leadership,  as 
compared  to  direction,  is  at  its  fullest.  This  is  the  highest  fonn  of  command  and  control.7 

Among  the  capabilities  that  are  required  for  the  implementation  of  FORCEnet  are:8 

•  Process,  sort,  analyze,  evaluate,  and  synthesize  large  amounts  of  disparate 
information  while  still  providing  direct  access  to  raw  data  as  required. 

•  Provide  each  decision  maker  the  ability  to  depict  situational  information  in  a 
tailorable,  user-defined,  sharable,  primarily  visual  representation. 

•  Provide  distributed  groups  of  decision  makers  the  ability  to  cooperate  in 
perfonnance  of  common  command  and  control  activities  by  means  of 
collaborative  work  environment. 

•  Automate  lower-order  command  and  control  sub-processes  and  to  use 
intelligent  agents  and  automated  decision  aids  to  assist  people  in  performing 
higher-order  sub-processes,  such  as  gaining  situational  awareness  and 
devising  concepts  of  operations. 

•  Provide  decision  makers  the  ability  to  make  and  implement  good  decisions 
quickly  under  conditions  of  uncertainty,  friction,  time,  pressure,  and  other 
stresses. 

The  FORCEnet  concept  is  envisioned  to  allow  for  commanders  operate  in  a 
collaborative  command  and  control  environment,  with  shorter  decision  cycles  so  that 


7  Department  of  the  Navy  Publication,  (2005)  “FORCEnet:  A  Functional  Concept  for  the  21st  Century,” 
p.  7.  Washington:  Department  of  the  Navy. 

8  The  complete  list  of  stated  FORCEnet  capabilities  is  found  in  the  FORCEnet  Functional  Concept  on 
pages  12  through  19. 
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decisions  can  be  made  are  a  tempo  which  the  enemy  cannot  tolerate.9  To  develop  the 
information  technology  required,  they  must  be  analyzed  within  the  context  of  the  human¬ 
centric  high-order  command  and  control  processes. 

The  primary  decision-making  process  of  the  warfighting  commander  is  the  planning 
process.  To  date,  the  planning  process  is  not  supported  at  the  tactical  level  with  IT  that 
allows  for  more  timely  and  accurate  decision-making.  For  the  FORCEnet  concept  to  be 
realized,  initiatives  in  IT  to  support  the  planning  process  must  be  developed  and 
implemented. 

B.  THE  JFMCC  PLANNING  PROCESS 

1.  Organization  of  the  JFMCC  Staff 

With  the  publication  of  the  NWDC  TACMEMO  3-32-03,  the  organization  of  the 
JFMCC  staff  was  fonnalized  to  provide  a  fully  integrated  naval  staff  at  the  operational  level 
of  war.  The  JFMCC  Staff  organization  is  based  upon  the  requirement  to  support  the 
JFMCC  by: 

•  Integrating  planning,  execution,  and  assessment  with  the  Joint  Forces 
Commander,  other  component  commanders,  and  subordinate  JFMCC 
elements. 

•  Providing  clear,  concise,  and  uncomplicated  plans  and  orders. 

•  Synchronizing  the  warfighting  functions  and  missions  areas  throughout  the 
maritime  force  to  achieve  unity  of  effort  and  to  harmonize  maneuver  and 
maximize  opportunities  for  surprise. 

•  Coordinate  maritime  response  to  emergent  battlefield  events  ensuring 
economy  of  force  to  achieve  a  clear,  decisive,  and  objective  while  ensuring 
adequate  security.10 

To  this  end,  the  JFMCC  staff  is  organized  into  six  centers:  Knowledge  Management, 
Maritime  Intelligence  and  Analysis,  Maritime  Future  Plans,  Maritime  Operations,  Maritime 

9  Department  of  the  Navy  Publication,  (2005)  “FORCEnet:  A  Functional  Concept  for  the  21st  Century.” 
Washington:  Department  of  the  Navy,  p.  1. 

10  Navy  Warfare  Development  Command  (2004),  “Navy  Warfare  Development  Command  TACMEMO 
3-32-03:  Joint  Forces  Maritime  Component  Commander  (JFMCC)  Planning  and  Execution,”  Newport,  Navy 
Warfare  Development  Command,  p.  3-1. 
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Logistics  Coordination,  and  the  Maritime  Support  Center.  This  organization  scheme 
replaces  the  traditional  J-coded  staff  organization  (J-l  administration,  J-2  Intelligence,  J-3 
Operations,  J-4  Logistics,  J-5  Plans,  J-6  Communications)  with  more  functional 
interrelationships  within  the  various  centers.  Figure  1  demonstrates  the  proposed  functional 
organization  of  the  JFMCC  staff: 
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Figure  1.  Organization  of  the  JFMCC  Staff  (From  NWDC,  2004) 
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2.  Future  Operations  Cell 

Within  the  Maritime  Operations  Center,  the  Future  Operations  Cell  is  the  primary, 
near-term  planning  agent  of  the  JFMCC.  The  Future  Operations  Cell  translates  operational 
objectives  assigned  to  the  JFMCC  into  tactical  missions  to  be  assigned  to  the  subordinate 
maritime  units.  The  Future  Operations  Cell  is  also  responsible  for  synchronizing  and 
coordinating  the  missions  assigned  to  subordinate  units  to  achieve  unity  of  effort  throughout 
the  entire  maritime  component.  As  the  Future  Operations  Cell  is  focused  primarily  on 
actions  to  be  taken  between  24  and  72  hours  in  the  future,  close  coordination  with  the 
Current  Operations  Cell  and  the  Maritime  Future  Plans  Center  is  essential  to  their  success. 
To  these  ends,  the  Future  Operations  Cell  is  organized  into  the  Planning  Team,  the  Maritime 
Tasking  Plan/Maritime  Support  Request  Coordination  Team,  the  Orders  Production  Team, 
and  the  Liaison  Team  as  depicted  in  Figure  2. 


Figure  2.  Organization  of  the  Future  Operations  Cell  (From  NWDC,  2004) 


3.  The  JFMCC  Planning  Process 

The  JFMCC  Planning  Process  was  formally  established  in  June  2004  with  the 
publication  of  NWDC  TACMEMO  3-32-03.  The  TACMEMO  provides  guidance  for  the 
planning  and  execution  of  maritime  operations  that  require  coordination  of  Navy,  Marine 
Corps,  and  coalition  forces  within  an  assigned  area  of  operations.11  The  JFMCC  planning 
process  provides  the  means  by  which  maritime  forces  submit  inputs  into  the  Joint, 
component,  and  subordinate  planning  processes  to  ensure  a  unity  of  effort  in  accomplishing 


1 1  Navy  Warfare  Development  Command  (2004),  “Navy  Warfare  Development  Command  TACMEMO 
3-32-03:  Joint  Forces  Maritime  Component  Commander  (JFMCC)  Planning  and  Execution.”  Newport.  Navy 
Warfare  Development  Command,  Preface. 
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missions.12  The  JFMCC  planning  process  is  executed  concurrent  with  the  other  component 
(Joint  Forces  Land  Component  Command,  Joint  Forces  Air  Component  Command,  Joint 
Forces  Special  Operations  Component  Command)  planning  processes  upon  receipt  of  the 
Joint  Forces  Command  (JFC)  Operations  Order  or  Warning  Order. 

The  JFMCC  planning  process  is  a  top-down  process  to  ensure  unity  of  command 
throughout  the  maritime  forces.  The  six  steps  to  the  JFMCC  planning  process  are:  Mission 
Analysis,  Course  of  Action  (COA)  Development,  COA  Analysis,  COA  Comparison  and 
Decision,  Orders  Development,  and  Transition.  The  JFMCC  Planning  Process  is  depicted 
as  the  six-step  sequential  process  in  Figure  3. 


12  Navy  Warfare  Development  Command  (2004),  “Navy  Warfare  Development  Command  TACMEMO 
3-32-03:  Joint  Forces  Maritime  Component  Commander  (JFMCC)  Planning  and  Execution,”  Newport,  Navy 
Warfare  Development  Command,  p.  4-1 
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Figure  3.  The  JFMCC  Planning  Process  (From  NWDC,  2004) 


Step  1  -  Mission  Analysis:  The  purpose  of  mission  analysis  is  to  conduct  a  review 
and  analysis  of  orders,  guidance,  and  any  other  information  provided  by  the  JFC  to  produce 
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a  JFMCC  mission  statement.  This  step  also  provides  a  means  by  which  the  situational 
awareness  of  the  commander  is  built  and  shared  throughout  the  planning  staff.  The 
commander  will  deliver  guidance  and  his  intent  to  his  planning  staff  to  focus  and  facilitate 
further  planning. 

Step  2  -  COA  Development:  With  the  JFMCC  mission  statement,  commander’s 
guidance,  commander’s  intent  and  JFC  mission  statement,  the  planning  staff  develops 
COAs  to  accomplish  the  assigned  mission.  Multiple  COAs  may  be  developed  to  provide 
the  commander  with  different  methods  of  achieving  the  goal.  Each  of  the  COAs  developed 
by  the  planning  staff  must  be  suitable,  feasible,  acceptable,  distinguishable,  and  complete. 
They  must  also  be  in  concert  with  the  mission  statement  and  commander’s  guidance  and 
intent. 

Step  3  -  COA  Analysis:  During  the  COA  analysis,  the  planning  staff  conducts  a 
detailed  assessment  of  each  of  the  COAs  developed  it  regard  to  the  enemy  and  the 
battlespace.  COAs  may  be  compared  to  potential  enemy  COAs  or  reactions  to  determine 
strengths  and  weaknesses  of  the  COA.  This  will  also  aid  in  development  of  branches 
(deviations  from  the  plan  bases  upon  unfolding  events)  or  sequels  (next  steps  that  are  taken 
upon  completion  of  a  plan).  During  the  COA  analysis,  planners  identify  strengths, 
weaknesses,  risks,  and  equipment  or  force  shortfalls  for  each  COA. 

Step  4  -  COA  Comparison  and  Decision:  During  COA  Comparison,  the  commander 
provides  comparison  criteria  for  all  COAs  and  then  compares  them  to  each  other.  The  staff 
and  subordinate  planners  will  provide  to  the  commander  their  recommendations  of  which 
COA  best  accomplishes  the  mission  from  their  perspective.  The  commander  will  then  select 
the  COA  that  he  detennines  to  best  accomplish  the  mission. 

Step  5  -  Orders  Development:  To  communicate  the  mission  to  the  maritime  forces, 
the  staff  prepares  an  operations  order  based  upon  the  COA  selected  by  the  commander.  The 
order  must  include  the  guidance  and  intent  provided  by  the  commander,  along  with  the 
course  of  action  and  the  individual  subordinate  missions. 
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Step  6  -  Transition:  The  goal  of  the  transition  step  is  to  ensure  an  orderly  handover 
of  the  plan  to  those  who  will  execute  the  operation.  Further  amplification  of  rationale  or 
situational  awareness  may  be  required  to  ensure  full  understanding  of  the  plan.13 

The  planning  staff  for  the  JFMCC  planning  process  is  an  Operational  Planning  Team 
(OPT).  The  members  of  the  OPT  are  members  of  the  JFMCC  future  operations  staff,  liaison 
officers  from  adjacent  and  subordinate  staffs,  and  other  external  personnel  with  subject 
matter  expertise. 


C.  DECISION  SUPPORT  SYSTEMS  TO  AID  THE  PLANNING  PROCESS 

A  Decision  Support  System  (DSS)  is  a  computer  tool  which  assists  human  decision 
makers  in  making  timelier  or  more  informed  decisions.  In  complex  decision  making 
processes  with  that  are  time  critical  and  that  have  great  associated  risk,  such  as  military 
planning,  DSSs  provide  the  greatest  potential  value.  This  research  will  examine  a  DSS  suite 
which  may  provide  automated  support  to  the  military  planning  processes  through  the  use  of 
artificial  intelligence.  Developed  under  funding  by  the  Army  Research  Laboratory,  the  DSS 
suite  comprised  of  the  CoRaven,  Weasel,  and  Fox  may  aid  the  planning  process  in 
unburdening  military  planners  during  crisis  planning  operations  by  aiding  in  the  analysis  of 
intelligence  data,  development  of  potential  enemy  courses  of  action  for  analysis,  and 
generation  of  friendly  courses  of  action.  Figure  4  depicts  the  CoRaven,  Weasel,  and  Fox 
suite  within  the  intelligence  collection  and  planning  cycle. 


13  Navy  Warfare  Development  Command  (2004),  “Navy  Warfare  Development  Command  TACMEMO 
3-32-03:  Joint  Forces  Maritime  Component  Commander  (JFMCC)  Planning  and  Execution,”  Newport,  Navy 
Warfare  Development  Command,  pp.  4-3  -  4-4. 
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Figure  4.  The  Intelligence  Collection  and  Planning  Cycle  (From  Hayes,  et  al.,  2002) 

1.  CoRaven 

CoRaven  is  a  decision  support  tool  designed  to  aid  in  the  planning  process  during 
times  of  crisis  by  processing  a  portion  of  intelligence  data  for  the  human  operator.  The  goal 
of  the  CoRaven  project  is  to  support  the  human  intelligence  analyst  with  “an  intelligent 
collaborative  multimedia  system.”  Using  Bayesian  networks14  as  its  reasoning  tool, 
CoRaven  presents  visual  data  to  the  operator  through  the  use  of  spatial  data  in  the  form  of 


14  Bayesian  networks  organize  the  knowledge  in  a  field  of  interest  as  a  branching  series  of  cause  and 
effect  relationships  between  key  variables.  Given  the  known  effects  as  observed  by  sensors  or  reconnaissance 
elements  (e.g.  troop  concentration  at  a  certain  location  and  artillery  battalion  located  at  a  certain  firing 
position)  the  Bayesian  network  determines  the  probability  of  the  potential  causes  (e.g.,  the  enemy  is  attacking 
along  Route  Blue).  More  information  regarding  Bayesian  networks  can  be  found  at 
http://www.niedermaver.ca/papers/bayesian  and  http://www.cs.ubc.ca/~murphvk/Baves/bnintro.html. 
Retreived  April  2006. 
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maps,  temporal  data  in  the  form  of  synchronization  matrices,  and  graph-based  models  for 
fusing  data  to  detennine  supporting  evidence.15 

In  order  for  the  CoRaven  DSS  to  be  functional  in  times  of  crisis,  the  human  operator 
inputs  his  own  analytical  logic  into  the  system  during  times  of  calm,  when  time  is  available, 
in  the  form  of  logic  trees. 

2.  Weasel 

Weasel  aids  the  military  planner  in  developing  potential  enemy  courses  of  action. 
Given  data  provided  through  intelligence  analysis  regarding  the  enemy  forces  disposition 
which  is  directly  transferred  from  the  CoRaven  system,  constraints  of  terrain,  and 
intelligence  assumptions,  that  are  inputted  by  the  human  operator  based  upon  enemy 
doctrine  or  displayed  tendencies,  Weasel  generates  a  set  of  possible  and  likely  enemy 
courses  of  action.  Limitations  of  Weasel  is  that  it  does  not  identify  enemy  courses  of  action 
that  are  inconsistent  with  the  given  inputs  and  it  does  not  designate  a  single  course  of  action 
as  that  which  would  pose  the  greatest  threat  to  friendly  forces.16  Figure  5  depicts  the  system 
components  of  the  Weasel  decision  support  tool. 


Figure  5.  A  System  Diagram  of  Weasel  Components  (From  Hayes,  et  ah,  2002) 


15  P.  Jones,  et  al  (1999).  “CoRAVEN:  Modeling  and  Design  of  a  Multimedia  Intelligent  Infrastructure  for 
Collaberative  Intelligence  Analysis.”  Federated  Laboratories  Annual  Research  Symposium.  Aberdeen,  p.  914. 
Retrieved  April  2006  from  http://ieeexplore.ieee.Org/iel4/5875/l 5656/00725532.pdf?amumbei^725532 

16  C.  Hayes,  A.  Larson,  U.  Ravinder  (2002),  “Weasel:  A  Mixed-Initiative  System  to  Assist  in  Military 
Planning.”  American  Association  of  Artificial  Intelligence,  p.  3.  Retrieved  April  2006  from 
http://www.cs.rochester.edu/research/mipas2005/final-drafts/hayes-larson-ravinder.pdf 
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With  Weasel,  the  military  planner  can  repeat  the  course  of  generation  multiple  times 
varying  the  inputted  constraints  or  can  modify  the  produced  courses  of  action  through  the 
graphical  user  interface.  After  refining  the  set  of  potential  enemy  courses  of  action  the 
planner  would  then  select  a  set  of  most  relevant  or  most  likely  course  of  action  against 
which  friendly  actions  can  be  evaluated.17 

3.  Fox 

Fox  is  a  DSS  which  assists  military  planners  in  identifying  potential  friendly  courses 
of  action.  Given  a  set  of  potential  enemy  courses  of  action,  Fox  uses  a  genetic  algorithm18 
to  generate  potential  friendly  courses  of  action.  19  Comparing  each  potential  friendly  course 
of  action  to  the  inputted  enemy  courses  of  action,  Fox  identifies  those  friendly  courses  of 
action  with  the  better  performance  in  terms  of  a  “fitness  function,”  which  is  computed  based 
upon  the  simulators  measure  of  the  remaining  strength  of  friendly  units,  the  remaining 
strength  of  enemy  units,  or  the  amount  of  terrain  gained/lost  during  the  battle.20  Given  the 
Fox  output,  the  human  decision  maker  is  required  to  select  which  course  of  action  for 
development  into  orders  for  execution. 

D.  RETURN  ON  INVESTMENT 

1.  Return  on  Investment  Defined 

The  tenn  Return  on  Investment  (ROI)  most  commonly  means  “...  a  performance 
measurement  used  to  evaluate  the  efficiency  of  an  investment  or  to  compare  the  efficiency 
of  a  number  of  different  investments.  To  calculate  ROI,  the  benefit  (return)  of  an  investment 


17  C.  Hayes,  A.  Larson,  U.  Ravinder  (2002),  “Weasel:  A  Mixed-Initiative  System  to  Assist  in  Military 
Planning.”  American  Association  of  Artificial  Intelligence,  p.  8.  Retrieved  April  2006  from 
http://www.cs.rochester.edu/research/mipas2005/final-drafts/haves-larson-ravinder.pdf 

18  A  genetic  algorithm  is  a  solution  technique  which  tests  a  set  of  solutions  against  the  problem  to 
determine  an  optimal  solution.  The  initial  set  of  solutions  are  randomly  created  and  then  tested  against  the 
problem.  The  most  “fit”  of  the  solutions  are  modified  and  selectively  combined  with  other  solutions  to  create 
the  next  generation  of  solutions.  This  next  generation  is  then  tested  for  “fitness.”  This  iterative  process 
continues  until  a  predetermined  termination  criterion  is  achieved  (e.g.,  a  certain  number  of  generations  into  the 
algorithm,  time,  or  no  improvement  in  fitness  is  achieved  through  mutation).  Retrieved  April  2006  from 
http://en.wikipedia.org/wiki/Genetic  algorithm. 

19  U.  Ravinder,  &  C.  Hayes  (2003).  “Weasel:  An  Automated  Planner  that  Users  Can  Guide,”  IEEE 
Systems,  Man  and  Cybernetics  (Washington,  October  5-8,  2003).  p.  955.  Retrieved  April  2006  from 
http://ieeexplore.ieee.org/iel5/881 1/2787 1/0 1243937.  pdf?  arnumber=1243937 

20  C.  Hayes,  J.  Schlabach,  C.  Fiebig  (1998),  “FOX-GA:  an  Intelligent  Planning  and  Decision  Support 
Tool”  Systems,  Man,  and  Cybernetics,  1998.  1998  IEEE  International  Conference  on  Volume  3,  11-14  Oct. 
1998,  p.2458. 
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is  divided  by  the  cost  of  the  investment;  the  result  is  expressed  as  a  percentage  or  a  ratio.”21 
To  express  ROI  as  a  percentage,  the  formula  for  calculation  is  : 

ROIJRevenue-Cost)xm% 

Cost 

When  calculating  the  ROI  of  an  individual  investment,  a  negative  ROI  (less  than 
0.00%)  implies  that  then  investment  generates  a  net  loss.  An  ROI  of  0.00%  implies  that  the 
investment  “breaks  even,”  with  no  net  gain  or  loss  of  investment.  A  positive  ROI  implies 
that  the  investment  generates  a  profit  for  the  investor. 

This  measure  of  ROI  is  of  greater  value  to  an  investor  when  two  or  more  alternative 
investments  are  compared  against  each  other.  For  example,  if  one  investment  provides  a 
higher  ROI  than  an  alternative,  a  logical  conclusion  is  that  the  investor  should  invest  in  the 
investment  with  the  higher  ROI. 

Measuring  ROI  for  a  commercial  organization  is  a  similar  process.  The  analyst 
needs  to  determine  the  costs  associated  with  the  investment  (equipment,  manpower,  etc.) 
and  the  potential  future  returns  that  will  be  generated  by  the  investment.  For  example,  if  a 
company  was  evaluating  whether  to  invest  in  a  radio  advertisement  campaign  they  would 
calculate  the  costs  (production,  airtime,  etc)  and  the  potential  returns  (revenue  generated  by 
the  campaign).  If  the  costs  were  calculated  to  be  $40,000  and  the  revenue  projected  to  be 
$75,000,  the  ROI  for  the  campaign  would  be  87.5%  (ROI  =  [($75,000  -  $40,000)/$40,000] 
xl00%).  This  measure  could  then  be  compared  to  the  alternatives  of  advertising  on 
television  or  the  alternative  of  not  advertising  (for  which  ROI  is  undefined). 

2.  Non-Profit  ROI 

A  non-profit  organization  has  been  defined  as  an  organization  “which  exists  to  do 
good,  where  the  mission  is  a  moral  absolute,  rather  than  an  economic  decision.”  A 
nonprofit  organization  can  be  categorized  as  performing  one  of  the  four  nonprofit  core 


21  Return  on  Investment  (ROI).  In  Investopedia.com  Dictionary.  Retrieved  March  2006  from 
http://www.investopedia.eom/terms/r/returnoninvestment.asp 
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functions:  promoting  civic  or  political  engagement,  providing  critical  services,  providing  a 
vehicle  for  entrepreneurship,  or  acting  as  an  outlet  for  the  expression  of  faith  and  values.22 

While  the  ROI  of  a  commercial  enterprise  can  be  evaluated  by  looking  at  historical 
or  projected  data  for  costs  and  revenues,  a  non-profit  organization  can  not  be  as  easily 
evaluated.  In  the  non-profit  organization,  cost  data  is  available  (manpower,  equipment, 
infrastructure,  etc.),  but  revenue  generated  is  not  available  because  no  monetary  value  is 
assigned  to  the  organizations  product.  For  such  an  organization,  a  method  for  determining 
the  revenue  generated  must  be  developed  for  an  ROI  analysis  to  be  conducted. 

Like  the  nonprofit  sector,  the  costs  associated  with  public  sector  organizations  (i.e. 
government  agencies)  are  also  easily  determined.  Annually,  budgets  are  submitted, 
reviewed,  and  approved  by  government  organizations  and  public  funds  from  taxes  are 
allocated  for  the  organizational  expenses  to  provide  services  to  the  citizens.  This  budget 
data  presents  costs,  but  does  not  determine  the  value  of  the  critical  services  that  the  public 
sector  organization  provides. 

As  with  the  nonprofit  organization,  government  organizations  do  not  easily  lend 
themselves  to  an  ROI  analysis  by  virtue  of  the  lack  of  revenue  generated  by  the 
organization.  Government  services  are  not  provided  in  a  free  market,  largely  because  no 
single  primary  benefactor  of  a  government  service  exists.  Rather,  the  community  as  a  whole 
benefits  from  the  public  sector  organization.  The  value  of  fire  departments  and  police 
departments  is  easy  to  theoretically  grasp,  so  much  that  the  existence  of  these  organizations 
are  largely  unquestioned.  However,  since  these  organizations  are  not  revenue  generators  in 
a  market  sense,  one  cannot  readily  assign  a  monetary  value  to  the  outputs  generated  by  them 
(e.g.  sense  of  security).  Since  the  services  provided  by  public  sector  organizations  are  not 
open  to  free  market  competition,  where  the  outputs  are  available  from  multiple  sources  at 
varying  degrees  of  quality  and  price,  revenues  need  to  be  determined  through  other  means. 

It  is  commonly  accepted  that  an  ROI  analysis  of  a  private  sector  organization  can 
provide  information  on  where  investments  should  be  made  to  increase  the  profitability  of 
the  organization.  For  the  public  sector  organization,  increased  profitability  is  not  a  likely 

22  M.  Dube,  B.  Vetting  (2004),  “MBA  Professional  Report:  Lessons  for  the  DoD  from  the  Nonprofit 
Sector.”  Monterey,  Naval  Postgraduate  School,  p.  3. 
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outcome,  since  no  profit  is  currently  achieved.  Rather,  an  ROI  analysis  will  potentially 
demonstrate  where  costs  in  the  system  to  produce  the  service  output  can  be  improved 
through  efficiency  so  that  a  more  economical  use  of  public  funds  can  be  achieved. 

3.  Information  Technology  ROI 

As  stated  in  the  FORCEnet  Functional  Concept,  one  of  the  capabilities  required  to 
achieve  the  FORCEnet  vision  is  to  “automate  lower-order  command  and  control  functions 
and  use  intelligent  agents  and  automated  decision  aids  to  assist  people  in  perfonning  higher- 
order  sub-processes,  such  as  gaining  situational  awareness  and  devising  concepts  of 
operations.”  Through  the  implementation  of  information  technologies  to  accomplish  lower- 
order  tasks,  it  is  envisioned  that  those  subprocesses  that  require  little  or  no  judgment  will  be 
conducted  more  efficiently  and  with  greater  accuracy  than  a  human  operator  could.  The 
human  who  currently  is  employed  with  these  tedious  tasks  could  be  freed  to  conduct 
subprocesses  requiring  greater  human  judgment.  The  resulting  efficiency  in  use  of  human 
capital  will  present  itself  in  lower  costs  with  the  labor  intensive  tasks  and  will  likely 
improve  the  ROI  of  the  process  as  a  whole. 

Given  the  benefits  envisioned  through  the  implementation  of  information 
technologies  in  command  and  control  processes,  a  means  to  objectively  and  consistently 
measure  the  impact  of  an  investment  on  the  processes  they  operate  within  is  required. 
a.  Current  Approaches 

There  are  currently  a  number  of  approaches  to  measuring  the  impact  of 
information  technology  on  an  organizations  perfonnance.  Table  1  summarizes  these 
approaches  and  their  associated  advantages  and  disadvantages: 
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Common  Approaches  to  Measuring  the  Return  on  IT 


Level  of 
Analysis 

Approach 

Focus 

Example 

Key 

Assumption 

Key  Advantage 

Limitation 

Process  of 

Elimination 

Treats  effect  of  IT  on 
ROI  as  a  residual 
after  accounting  for 
other  capital 
investments 

Knowledge 

capital 

(Strassmann 
2000a,  b) 

ROI  on  it  difficult 
to  measure 
directly 

Uses  commonly 
accepted 
financial  analysis 
techniques  and 
existing 

accounting  data 

Cannot  drill  down 
to  effects  of 
specific  IT 
initiatives 

Aggregate 

Corporate 

(firm)  level 

Production 

Theory 

Determines  the 
effects  of  IT  through 
input  output  analysis 
using  regression 
modeling  techniques 

Brynjolfsson  & 
Hitt  (1996) 

Economic 
production 
function  links  IT 
investment  input 
to  productivity 
output 

Uses 

econometric 
analysis  on  large 
data  sets  to  show 
contributions  of 

IT  at  firm  level 

"Black-box" 
approach  with  no 
intermediate 
mapping  of  IT's 
contributions  to 
outputs 

Resource- 

Based  View 

Linking  firm  core 
capabilities  with 
competitiveness 

Jarvenpaa  & 
Leidner  (1998) 

Uniqueness  of  IT 
resource  = 
competitive 
advantage 

Strategic 
advantage 
approach  to  IT 
impacts 

Causal  mapping 
between  IT 
investment  and 
firm  competitive 
advantage  difficult 
to  establish 

Corporate/ 

sub¬ 

corporate 

Option 

Pricing 

Model 

Determines  the  best 
point  at  which  to 
exercise  an  option  to 
invest  in  IT 

Benaroch  & 

Kauffman 

(1999) 

Timing  exercise 
option  =  value 

Predicting  the 
future  value  of  an 

IT  investment 

No  surrogate  for 
revenue  at  sub 
corporate  level 

Family  of 

Measures 

Measure  multiple 
indicators  to  derive 
unique  contributions 
of  IT  at  sub-corporate 
level 

Balanced 
score-card 
(Kaplan  & 
Norton,  1996) 

Need  multiple 
indicators  to 

measure 

performance 

Captures 
complexity  of 
corporate 
performance 

No  common  unit 
of  analysis/ 
theoretical 
framework 

Sub¬ 

corporate 

(Process) 

Cost-Based 

Use  cost  to 
determine  value  of 
information 
technology 

Activity-based 

costing 

Johnson  & 
Kaplan  (1987) 

Derivations  of 
cost »  value 

Captures 
accurate  cost  of 

IT 

No  surrogate  for 
revenue  at  sub 
corporate  level  - 
no  ratio  analysis 

Knowledge 

Value 

Added 

Allocating  revenue  to 

IT  in  proportion  to 
contributions  to 
process  outputs 

Housel  & 
Kanevksy 
(1995) 

IT  contributions 
to  output » IT 
value-added 

Allocates 
revenue  and  cost 
of  IT  allowing 
ratio  analysis  of 

IT  value-added 

Does  not  apply 
directly  to  highly 
creative 
processes 

Table  1.  Common  Approaches  to  Measuring  the  Return  on  IT  (  From  Pavlou,  P.,  et  ah,  2005) 

These  approaches  can  be  categorized  into  two  groups  based  upon  the  levels 
at  which  they  analyze  the  impact  of  the  infonnation  technology,  the  corporate  level  and  the 
sub-corporate  level.  The  corporate  level  analysis  approaches  seek  to  determine  the 
contribution  of  assets  on  the  overall  performance  of  the  organization.  The  sub-corporate 
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approaches  attempt  to  look  internal  to  the  organization  at  the  processes  which  produce  the 
organization’s  output  and  to  measure  the  impact  of  assets  within  these  processes.  The 
overall  goal  for  each  of  these  approaches  is  to  provide  to  the  decision  maker  a  measure  of 
the  impact  of  information  technology  investments  at  the  particular  level  at  which  they 
analyze. 

b.  DoD  Information  Technology  Investments 

The  Information  Technology  Management  Reform  Act  of  1996,  commonly 
known  as  the  Clinger-Cohen  Act,  had  a  dramatic  impact  on  the  federal  government  and  the 
way  by  which  information  technologies  were  developed  and  purchased.  The  Clinger-Cohen 
Act  mandated  that  the  Chief  Information  Officers  review  the  acquisition  of  infonnation 
technology  systems  and  provide  accountability  for  the  investments  made.23  The  Clinger- 
Cohen  Act  directed  that  the  acquisition  of,  planning  for,  and  management  of  technology  be 
treated  as  “capital  investments”  and  that  DoD,  along  with  all  other  federal  agencies, 
conducts  a  cost/benefit  analysis  of  the  technology  prior  to  purchase.24 

The  following  chapters  provide  detailed  background  information  of  the 
Knowledge  Value  Added  methodology  and  demonstrate  the  use  of  the  methodology  as  a 
means  of  conducting  this  cost/benefit  analysis  within  the  process  that  the  technology  would 
support. 


23  M.  Browning,  (June  20,  2005).  “Executive  Suite:  Putting  the  Clinger-Cohen  Act  into  Perspective.” 
Government  Computer  News,  24.  Retrieved  April  2006  from  http://www.gcn.com/24_15/project- 
management/3  6 103-1  .html 

24  Department  of  Education.  “Clinger-Cohen  Act.”  Retrieved  April  2006  from 
http://www.ed.gov/policy/gen/leg/cca.html. 
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III.  THE  KNOWLEDGE  VALUE-ADDED  METHODOLOGY 


A.  THE  VALUE  PROBLEM 

The  Clinger-Cohen  Act  directs  that  a  cost/benefit  analysis  for  IT  systems  be 
conducted  prior  to  the  acquisition  of  the  systems.  To  be  mathematically  correct,  in 
detennining  the  ROI  for  an  IT  investment,  the  value  of  an  investment  must  be  established  in 
a  unit  of  measure  common  with  the  cost  of  the  investment.  Since  the  “cost”  associated  with 
IT  investments  is  monetary,  the  value  derived  from  the  benefits  must  also  be  stated  in 
monetary  terms.  In  private  sector  organizations,  the  monetary  value  can  be  measured  when 
assigning  the  unit  price  to  the  process  output.  However,  this  measure  of  value  does  not 
provide  a  complete  understanding  of  the  value  of  the  investment  made.  It  captures  the  value 
only  at  the  boundary  between  the  process  and  the  free  market.  It  does  not  determine  the 
value  of  the  process  assets  that  work  within  the  organization  to  produce  the  final  product. 

In  nonprofit  and  public  sector  organizations  the  difficulty  of  assigning  value  to  an 
investment  is  greater.  The  DoD,  for  example,  is  incapable  of  detennining  directly  the 
monetary  value  of  IT  investments  because  it  does  not  offer  its  process  outputs  to  the  free 
market.  Therefore  it  is  necessary  that  an  alternative  common  unit  be  used  in  detennining 
the  value  of  investments. 

B.  THE  KNOWLEDGE  VALUE-ADDED  METHODOLOGY 

The  Knowledge  Value-Added  (KVA)  methodology  provides  a  framework  for 
detennining  the  value  of  subprocesses  and  process  assets  within  an  organizational  process. 
Developed  by  Dr.  Thomas  Housel  and  Dr.  Valery  Kanevsky  of  the  Naval  Postgraduate 
School,  KVA  addresses  the  longstanding  need  of  executives  and  managers  to  be  able  to 
measure  the  value  of  the  knowledge  that  exists  within  employees,  processes,  and  IT.  The 
KVA  analysis  produces  a  return-on-knowledge  (ROK)  ratio  to  show  the  estimated  value 
added  by  process  assets  to  the  final  process  output. 
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1.  KVA  Theory 

The  KVA  methodology  was  developed  on  the  concepts  of  entropy  and  complexity25, 
stating  that  organizations  add  value  through  its  core  processes  by  changing  the  process 
inputs  (e.g.  raw  materials,  labor,  energy,  information)  into  the  process  outputs  (e.g.  products 
and  services)  that  generate  the  organization’s  revenue.26  The  amount  of  change  that  occurs 
to  the  input  to  create  the  output  can  therefore  be  a  measure  of  the  value  added  during  the 
process. 

KVA  uses  a  knowledge-based  metaphor  to  operationalize  the  relationship  between 
the  change  that  occurs  to  the  input  to  generate  the  output  through  the  organizations  core 
processes.  The  amount  of  change  can  be  described  in  terms  of  the  amount  of  knowledge 
required  to  make  that  change.  Figure  6  depicts  the  key  assumptions  of  the  KVA 
methodology. 


Input  Process  Output 


P(X)=  Y 

Fundamental  Assumptions: 

1.  If  X=Y,  no  value  added  by  process 

2.  “value'’cx:  "change” 

3.  “change"  can  be  measured  by  the 
amount  of  knowledge  required  to  make 
the  change 

So,  'Value"  oc  "change"  oc  "amount  of  knowledge 
required  to  make  the  change” 


Figure  6.  Fundamental  Assumptions  of  KVA  (From  Housel  &  Bell,  2001) 

25  In  simple  terms,  the  Kolmogorov  Complexity  (K-Complexity)  of  an  object  is  the  length  of  the  shortest 
possible  computer  program  which  can  replicate  the  object.  A  more  complex  object  requires  a  greater  amount 
of  knowledge  to  replicate.  (“Greg  Harfst's  Home  Page:  Kolmogorov  Complexity.”  Retrieved  April  2006  from 
http://nms.csail.mit.edu/~gch/kolmogorov.html). 

26  T.  Housel,  &  A.  Bell,  (2001),  Managing  and  Measuring  Knowledge.  Boston:  McGraw-Hill  Higher 
Education,  pp.  91-92. 
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2.  Identification  of  Core  Processes 

In  order  to  utilize  the  KVA  methodology,  the  core  processes  of  the  organization  that 
creates  the  output  from  inputs  must  be  identified  and  the  change  that  occurs  to  the  process 
inputs  within  these  processes  must  be  defined.  To  this  end  various  sources  of  information 
may  be  called  upon  to  ensure  that  the  completeness  of  the  list.  For  example,  an  analyst  may 
use  a  survey  of  organizational  managers  or  executives,  queries  of  subject  matter  experts  who 
are  familiar  with  the  organization,  or  procedural  publications  or  checklists  that  identify  the 
processes  in  a  linear  system.  Key  to  the  identification  of  the  core  processes  is  the 
identification  of  the  boundaries  of  the  processes,  where  the  process  outputs  can  be  identified 
for  each  individual  core  process  prior  to  the  initiation  of  a  proceeding  process. 

3.  Approaches  to  Measuring  Knowledge 

The  knowledge  within  an  organization’s  processes  can  be  measured  through  various 
means  so  long  as  the  basic  assumptions  of  KVA  are  satisfied  and  the  approach  is  used  to 
consistently  throughout  the  core  process.  For  the  purposes  of  this  research,  the  Learning 
Time,  Process  Description,  and  Binary  Query  Method  techniques  are  presented  in  Table  2, 
with  the  Learning  Time  Approach  described  in  greater  detail  in  narrative. 


Step 

Learning  Time 

Process  Description 

Binary  Query  Method 

1. 

Identify  core  process  and  its  subprocesses. 

2. 

Establish  common  units  to 
measure  learning  time. 

Describe  the  product  in  terms 
of  the  instructions  required  to 
reproduce  them  and  select  unit 
of  process  description. 

Create  a  set  of  binary  yes/no 
questions  such  that  all  possible 
outputs  are  represented  as  a 
sequence  of  yes/no  answers. 

3. 

Calculate  the  learning  time  to 
execute  each  subprocess. 

Calculate  number  of  process 
instructions  pertaining  to  each 
subprocess. 

Calculate  length  of  sequence 
of  yes/no  answers  for  each 
subprocess. 

4. 

Designate  sampling  time  period  long  enough  to  capture  a  representative  sample  of  the  core 
process's  final  product/service  output. 

5. 

Multiply  the  learning  time  for 
each  subprocess  by  the 
number  of  times  the 
subprocess  executes  during 
the  sample  period. 

Multiply  the  number  of  process 
instructions  used  to  describe 
each  subprocess  by  the 
number  of  times  the 
subprocess  executes  during 
the  sample  period. 

Multiply  the  length  of  yes/no 
string  for  each  subprocess  by 
the  number  of  times  the 
subprocess  executes  during 
the  sample  period. 

6. 

Allocate  revenue  to  subprocesses  in  proportion  to  the  quantities  generated  by  step  5  and 
calculate  the  cost  for  each  subprocess. 

7. 

Calculate  ROK,  and  interpret  results. 

Table  2.  Three  Approaches  to  KVA  (From  Housel  &  Bell,  2001) 
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a.  The  Learning  Time  Approach 

Of  the  various  methods  of  estimating  the  knowledge  required  to  generate 
process  output  from  input,  the  learning  time  is  most  often  utilized  in  core  processes  with  a 
high  degree  of  human  interaction.  The  Learning  Time  Approach  provides  a  convenient 
estimation  because  the  knowledge  required  to  execute  a  process  is  proportional  to  the  time 
required  to  learn  it.  Therefore,  the  average  time  required  for  a  person  to  learn  how  to 
execute  a  process  is  proportional  to  the  amount  of  new  knowledge  required.27  Learning 
time  must  be  measured  in  terms  of  common  units  of  time  throughout  the  processes  of 
interest,  and  it  is  these  common  units  that  become  common  units  of  output. 

b.  Reliability  of  Learning  Time  Estimation 

Although  the  Process  Instruction  and  Binary  Query  Method  approaches  to 
measuring  the  knowledge  required  to  create  a  process  output  are  more  accurate  than  the 
Learning  Time  Approach,  for  many  processes  such  detailed  infonnation  is  not  readily 
available.  To  use  the  Learning  Time  Approach  to  measure  knowledge  requires  that  the 
analyst  be  able  to  establish  the  reliability  of  the  estimates.  Reliable  estimates  of  learning 
time  can  be  made  when  there  exists  formal  training  or  education  requirements  to  execute  a 
core  process.  In  such  a  case,  the  time  actively  spent  learning  will  provide  a  very  sound 
measure  of  the  knowledge  required.  However,  within  many  organizations,  the  knowledge 
required  to  execute  the  core  processes  is  learned  by  observation  and  execution  of  the  core 
processes.  In  this  case,  where  time  is  not  specifically  allocated  to  learning  the  required 
knowledge,  estimation  of  learning  time  is  required.  To  establish  reliability  of  the  estimates, 
multiple  executives,  managers,  or  subject  matter  experts  with  in  depth  familiarity  with  the 
overall  core  process  may  be  surveyed  to  determine  the  relative  time  that  must  be  dedicated 
by  a  new  “average”  employee  to  learn  all  knowledge  to  execute  the  core  process.  The 
estimates  provided  by  these  multiple  sources  can  be  statistically  compared  to  each  other  to 
identify  the  level  of  correlation  that  exists  between  respondents.  A  correlation  of  80%  or 
greater  between  responses  is  sufficient  to  establish  reliable  estimates  of  the  relative 
knowledge  embedded  within  the  processes. 

27  V.  Kanevsky,  T.  Housel  (1998),  “The  Learning-Knowledge- Value  Cycle”  in  Knowing  in  Firms: 
Understanding,  Managing,  and  Measuring  Knowledge.  G.  Von  Krogh,  J.  Roos,  D.  Kleine  (Eds),  New  York: 
Sage.  p.  273. 
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IV.  METHODOLOGY  PROOF  OF  CONCEPT 


A.  INTRODUCTION 

The  Trident  Warrior  Experiment  is  the  annual  FORCEnet  sea  trial  event  that  was 
designed  to  create  an  “environment  in  which  to  assess,  in  quantitative  and  qualitative  terms, 
FORCEnet  systems  including  technology,  tactics/techniques/procedures  (TTP’s) — 
providing  specific  insights  and  dedicated  procurement  and  development  decision 
information.”28  The  experimentation,  led  by  the  Naval  Network  Warfare  Command 
(NNWC),  is  conducted  in  a  realistic  fleet  environment  aboard  vessels  at  sea  to  provide 
recommendations  to  the  Military  Utility  Assessment  (MU A)  Board  regarding  the  adoption 
of  the  technologies  and  processes  examined  in  both  qualitative  and  quantitative  measures. 

Along  with  serving  as  the  Navy’s  Functional  Component  Commander  to  the  US 
Strategic  Command,  NNWC’s  Global  Mission  is  to  create  “warfighting  and  business 
options  for  the  Fleet  to  fight  and  win  in  the  information  age.  (To)  deliver  and  operate  a 
reliable,  secure  and  battle-ready  global  network.  (To)  lead  the  development  and  integration 
of  Information  Operations  capabilities  into  the  Fleet.”  With  the  guiding  principle  of  the 
FORCEnet  Functional  Concept  as  the  means,  NNWC  seeks  to  provide  the  Naval  Command 
and  Control  for  the  21st  Century.29  To  this  end,  the  Trident  Warrior  experiments  serve  as  a 
primary  source  of  reliable  infonnation  to  the  Commander  of  NNWC  regarding  technology 
and  processes  which  should  be  adopted  or  accelerated  through  the  procurement  process.30 

The  following  proof-of-concept  will  be  used  as  the  “as-is”  process  with  information 
collected  from  observation  and  survey  of  the  Second  Fleet  staff  execution  the  mission 
planning  required  during  the  experiment.  The  KVA  methodology  will  be  applied  to  analyze 
the  theory  that  process  re-engineering  and  automation  will  provide  significant  improvement 
to  the  planning  process  in  terms  of  efficiency.  Notional  information  technologies  will  be 


28  Naval  Network  Warfare  Command,  “TW  05  Overview”  PowerPoint  Presentation  presented  by  Brad 
Poeltler,  TW  05  Deputy  Director  11  August  2005. 

29  Naval  Network  Warfare  Command,  “NETWARCOM  Mission  Statement  and  Guiding  Principles”. 
Retrieved  April  2006  from  https://ekm.netwarcom.navy.mil/netwarcom/nnwc-nipr/index.htm 

30  Naval  Network  Warfare  Command,  “TW  05  Overview”  PowerPoint  Presentation  presented  by  Brad 
Poeltler,  TW  05  Deputy  Director  11  August  2005. 


27 


introduced  in  “to-be”  scenarios.  The  effects  of  the  notional  information  technologies  will  be 
detennined  through  a  KVA  analysis,  which  will  be  compared  to  the  current  “as-is”  process. 


B.  SECOND  FLEET  PLANNING  PROCESS  IN  TW  05 

In  order  to  determine  the  effects  of  future  information  technologies  in  the  planning 
process,  a  baseline  measure  of  the  current  “as-is”  process  must  be  made.  During  Trident 
Warrior  2005  (TW  05),  which  was  held  in  November-December  2005  in  the  Virginia  Capes 
region,  Commander  Second  Fleet  (C2F)  served  in  the  role  of  the  Coalition  Forces  Maritime 
Component  Commander  (CFMCC). 

The  C2F  Future  Operations  Department  (FOPs)  is  largely  responsible  for  the 
development  of  the  operational  plan  for  C2F.  During  TW  05,  the  FOPs  developed  one 
operational  plan  focusing  on  the  exploitation  of  a  scenario  terrorist  camp.  As  part  of  the 
task  received  from  the  notional  Joint  Task  Force  Headquarters,  C2F,  as  CFMCC,  was 
directed  to  “conduct  military  operations  to  conduct  sensitive  site  exploitation”  and  to 
capture  suspected  terrorist  ringleaders. 

Throughout  TW  05,  Subject  Matter  Experts  (SMEs)  from  the  C2F  staff  were 
surveyed  in  order  to  identify  the  subprocesses  of  the  planning  process.  The  C2F  Planning 
Process,  as  agreed  by  these  SMEs,  can  be  defined  in  the  sequential  subprocesses: 

•  Mission  Analysis:  Analysis  of  the  current  enemy  forces,  friendly  forces,  and 
the  task  assigned  by  higher  headquarters. 

•  Course  of  Action  (COA)  Development:  Development  of  feasible  options 
from  which  the  CFMCC  may  prosecute  the  assigned  task. 

•  COA  Analysis:  Evaluation  of  the  COAs  developed  in  terms  of  the  principles 
of  leverage,  operational  maneuver,  synergy,  tempo,  balance,  objective,  and 
agility.  The  COAs  are  also  evaluated  by  the  staff  in  tenns  of  subject  area  in 
terms  of  supportability  within  that  subject  matter. 

•  COA  Comparison  and  Decision  :  Presentation  of  the  COAs  and  the  analysis 
to  the  CFMCC  for  a  determination  of  which  is  to  be  adopted  for  further 
development  into  the  Concept  of  Operations  (ConOps)  which  will  be 
executed  to  fulfill  the  assigned  mission.  The  CFMCC  may  additional 
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provide  amplifying  remarks  and  questions  which  will  alter  the  COA  selected. 
The  CFMCC  also  has  the  option  of  rejecting  all  CO  As  developed  and  require 
that  planning  start  anew. 

•  ConOps  Development:  The  selected  COA  is  further  developed  in  detail  to  a 
level  of  clarity  that  allows  for  it  to  be  executed  by  subordinate  commands. 

•  ConOps  Approval:  The  detailed  ConOps  is  presented  to  the  CFMCC  to 
ensure  that  the  staff  has  developed  it  to  his  satisfaction.  Further  guidance 
may  be  received  direction  modification  of  the  ConOps  or  the  ConOps  may  be 
accepted  by  the  CFMCC. 

This  planning  process  is  similar  to  the  JFMCC  Planning  Process  as  presented  in  the 
Navy  Warfare  Development  Command  (NWDC)  TACMEMO  3-32-03,  with  the  exception 
of  the  ConOps  Development  and  ConOps  Approval  subprocesses.  In  the  NWDC 
TACMEMO,  the  ConOps  Development  is  included  in  the  COA  Comparison  and  Decision 
subprocess  while  the  ConOps  Approval  is  part  of  the  Orders  Development  subprocess.31 

The  C2F  FOPs  assigned  an  Operational  Planning  Team  (OPT)  to  conduct  the 
planning  for  the  assigned  mission.  Individuals  selected  for  assignment  to  the  OPT  were 
assigned  on  a  basis  of  availability  and  subject  area  expertise.  The  OPT  consisted  of: 


OPT  Leader:  USN  0-5 

OPT  Intelligence  Planner:  USA  0-5 

OPT  Land  Planner:  USA  0-4 

OPT  Ground  Fires  Planner:  USA  0-4 

OPT  Special  Operations  Forces  Planner:  USN  0-3 


Other  CFMCC  Planners  that  interacted  with  the  planning  process  were: 

CFMCC:  RN  Commodore 

C2F  Operations:  USN  0-6 

C2F  Future  Operations  Officer:  USMC  0-5 

Iwo  Jima  Expeditionary  Strike  Group  (ESG)  Commander:  USN  0-6 
24th  Marine  Expeditionary  Unit  (MEU)  Executive  Officer:  USMC  0-6 

31  Navy  Warfare  Development  Command  (2004),  “Navy  Warfare  Development  Command  TACMEMO 
3-32-03:  Joint  Forces  Maritime  Component  Commander  (JFMCC)  Planning  and  Execution”,  pp.  A-29  to  A- 
33.  Newport,  Navy  Warfare  Development  Command. 
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C2F  Information  Operations  Planner:  USAF  0-5 

C2F  Fires:  USAF  0-4 

ESG  Planner:  USN  0-3 

MEU  Planner  (S-2A):  USMC  0-3 

MEU  Planner  (S-6A):  USMC  0-3 


The  planning  process  was  initiated  on  Monday  5  December  with  the  receipt  of  the 
order  tasking  from  the  White  Cell  in  the  role  of  the  JTF  Commander.  Mission  Analysis  was 
conducted  for  a  period  of  1.5  hours,  an  artificiality  brought  about  by  the  Trident  Warrior 
Experiment.  The  week  prior  to  the  experiment,  the  staff  had  executed  planning  on  the  same 
objective,  and  thus  the  Mission  Analysis  presented  on  5  December  was  a  product  of  28 
November.  The  amount  of  time  dedicated  during  the  28  November  planning  exercise  to  the 
development  of  the  Mission  Analysis  was  reported  to  be  four  hours  by  the  OPT  Land 
Planner  and  16  hours  by  the  OPT  Intelligence  Planner.  For  the  KVA  analysis,  the  initial 
time  required  for  Mission  Analysis  was  applied  for  calculations  of  knowledge  and  cost.  The 
Mission  Analysis  results  were  then  presented  to  the  CFMCC  with  four  suggestions  for  COA 
Development.  The  CFMCC  rejected  one  of  the  COAs  as  unfeasible  in  accomplishing  the 
assigned  task. 

Following  the  Mission  Analysis,  COA  Development  was  undertaken  by  the  planning 
team.  The  OPT  Leader,  based  on  the  CFMCC  guidance,  detennined  that  three  COAs  were 
to  be  developed  for  analysis.  The  three  COAs  were  “Political  Influence,”  “Non-kinetic 
Infonnation  Operations,”  and  “Raid.”  The  OPT  Leader  assigned  responsibility  for  the 
development  of  these  three  COAs  to  three  different  individuals  based  on  their  expertise.  He 
assigned  himself  as  the  Political  Influence  COA  lead,  the  C2F  Infonnation  Operations 
Planner  as  the  Non-Kinetic  Information  Operations  COA  lead,  and  the  24th  MEU  staff  was 
assigned  the  Raid  COA. 

Upon  completion  of  the  COA  Development,  a  meeting  was  convened  for  COA 
Analysis  and  staff  estimation.  The  COA  leads  presented  the  COAs  developed  by  their 
particular  team.  Upon  completion  of  the  presentation  of  the  COAs,  the  COAs  were 
evaluated  by  the  collective  group  in  terms  of  the  principles  of  leverage,  operational 
maneuver,  synergy,  tempo,  balance,  objective,  and  agility.  This  was  conducted  in  the  open 
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forum  to  allow  all  members  of  the  audience  to  inject  comments  for  group  consideration. 
The  COAs  were  also  evaluated  by  the  staff  in  terms  of  supportability  within  their  subject 
matter  expertise.  The  results  of  this  analysis  were  recorded  for  presentation  to  the  CFMCC. 

Following  the  COA  Analysis  conducted  by  the  planning  staff,  the  FOPs  Officer  and 
the  OPT  Leader  presented  the  COAs  to  the  CFMCC,  Operations  Officer,  ESG  Commander, 
and  the  MEU  Commander.  The  CFMCC  directed  that  the  Raid  COA  be  developed  as  the 
ConOps  with  the  modification  that  the  developed  ConOps  include  an  alternate  insertion 
method. 

Following  the  CFMCC's  decision,  the  planning  team  from  the  24  MEU  that 
developed  the  Raid  COA  convened  to  develop  the  ConOps  for  the  raid  as  directed  by  the 
CFMCC. 

Upon  completion  of  ConOps  Development,  the  ConOps  was  presented  to  the 
CFMCC  for  approval.  The  CFMCC  approved  the  ConOps  as  presented  with  no 
modification,  only  amplifying  remarks. 

With  the  CFMCC’s  approval,  the  ConOps  would  be  further  developed  into  the 
operations  order  for  delivery  to  and  execution  by  the  subordinate  commands.  This  further 
development  of  the  operations  order  did  not  occur  during  TW  05  due  to  exercise 
considerations. 

C.  DATA  COLLECTION  METHODOLOGY 

The  data  for  this  research  was  collected  throughout  the  TW  05  experiment  aboard 
the  USS  IWO  JIMA.  During  the  data  collection,  members  of  the  C2F,  IWO  JIMA  ESG, 
and  24  MEU  staffs  were  observed  and  surveyed.  The  C2F  Planning  Process,  as  described 
above,  served  as  the  framework  in  which  data  was  collected. 

1.  Assumptions 

a.  Length  of  Sample  Period 

The  sample  period  for  this  analysis  was  four  work  days  (a  single  iteration  of 
the  planning  process).  For  this  reason,  some  annual  cost  data  is  adjusted  to  reflect  this 
sample  period. 
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b. 


Cost  of  Human  Capital 


Manpower  costs  for  this  analysis  were  derived  from  the  CY  2005  military 
pay  scale  available  from  the  Defense  Finance  and  Accounting  Service32  and  the  Basic 
Allowance  for  Housing  Calculator  available  from  the  Department  of  Defense  Per  Diem, 
Travel  and  Transportation  Allowance  Committee.33  To  detennine  the  costs  associated  with 
the  planning  process  and  subprocesses,  estimated  salary  data  was  detennined  for  each  of  the 
actors  involved.  This  data  included  the  base  pay  salary  for  one  month  and  the  Basic 
Allowance  for  Housing  (BAH)  for  one  month.  This  salary  value  was  then  multiplied  by  12 
months  to  determine  the  yearly  salary  and  housing  allowance  for  the  actor.  This  yearly  total 
was  then  divided  by  2000  hours  to  detennine  the  cost  of  that  individual  for  one  hour.  This 
value  was  then  multiplied  by  the  time  required  to  accomplish  a  subprocess  for  that  actor. 
For  the  CFMCC,  the  US  equivalent  of  an  0-7  was  used  in  detennining  salary  data.  For  all 
actors  the  Norfolk,  VA  BAH  with  dependants  rate  was  used  with  the  exception  of  the  24th 
MEU  actors,  for  whom  the  Jacksonville,  NC  BAH  with  dependants  rate  was  used.  Both 
base  pay  and  BAH  data  was  detennined  using  the  2005  scale. 

c.  Proxy  Revenue  Assumptions 

Proxy  revenue  values  are  based  on  the  assumption  that  commercial 
organizations  produce  a  comparable  product  or  service  as  the  public  sector  organization  and 
that  the  processes  which  generate  this  output  is  comparable  to  that  of  the  public  sector 
organization.  As  market  forces  have  placed  a  “value”  on  the  commercial  product  which 
yields  the  revenue  stream  for  the  commercial  organization,  this  “value”  can  be  applied  to  the 
public  sector  organization’s  product  or  service  for  the  sake  of  generating  an  analytical  or 
hypothetical  revenue  generating  stream.  For  this  research,  three  consulting  firms  which 
produce  business  strategy  plans  were  surveyed  to  yield  a  market  comparable  value  of  the 
planning  process. 


32  DoD,  2005  Military’  Pay  Rates.  Retrieved  February  2006  from 
http://www.dod.mil/dfas/militarvpav/2006militarvpavtables/militarvpaypriorrates/pavtable2005-revl.pdf. 

33  DoD,  Basic  Allowance  For  Flousing  Rates  Calculator.  Retrieved  February  2006  from 
https://secureapp2.hqda.pentagon.mil/perdiem/bah.html. 
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Debra  Conkey  Communications 

Debra  develops  strategic  marketing,  advertising,  employee 
communications  and  public  relations  programs  for  clients  worldwide,  and 
includes  both  traditional  and  Internet-based  strategies.  She  builds  long-term 
relationships  with  people,  so  clients  can  expect  consistent,  impactful  results. 
Debra  can  assemble  and  project  manage  a  virtual  team  of  experts  to  meet 
your  more  specialized  needs.  This  could  include  the  research,  development, 
marketing,  and  tracking  of  a  Web  site,  creating  an  interactive  press  kit  about 
your  product  or  service  that  can  be  downloaded  from  the  Internet  by  the  news 
media,  developing  and  implementing  an  integrated  plan  for  your  travel, 
medical,  high-tech  or  other  business,  and  more.  Debra  has  won  38  awards 
and  was  named  Communicator  of  the  Year  by  the  International  Association 
of  Business  Communicators  in  1995. 

(http://www.thecommunicators.org/dir/debra-conkey.html) 

Estimated  retail  value  of  Plan:  $7, 500. 34 

MarCom  Interactive 

We  strategize  and  implement  modem  media.  We  translate  modern 
media,  make  it  relevant  and  apply  it  to  our  clients'  marketing  and 
communications  needs. 

We  immerse  ourselves  in  what  is  happening  in  modern  media  around  the 
globe  so  we  can  detect  trends  and  help  you  create  opportunities.  We  show 
you  how  people  are  interacting  with  modern  media  so  together  we  can  craft 
new  ways  to  implement  your  marketing  communications  or  to  add  some 
inspiration  to  your  brand. 

Observing  trends  keeps  us  ahead  and  allows  us  to  spot  new  market 
opportunities.  Traversing  the  landscape  of  the  new  ways  people  are 
communicating,  behaving  and  purchasing  lets  us  help  you  interact  with 
customers  the  way  they  expect  and  welcome  -  and  in  ways  you  may  be 
overlooking. 

Modern  media  isn’t  stale  web  sites,  mass  email,  and  advertising  disguised  as 
newsletters  or  white  papers. 

We  provide  fresh  ideas,  inspiration,  and  creativity  and  we  do  it  with  passion, 
professionalism  and  attention  to  what  you  need. 

Our  seminars,  modern  media  reports,  webcasts,  articles,  and  The  Modohood 
(here  at  our  web  site)  is  a  great  place  to  begin  to  explore  what  modem  media 
is  and  what  you  can  do  for  your  organization. 
(http://marcominteractive.com/about/) 


D.  Conkey.  Telephone  conversation  with  Debra  Conkey  on  25  January  2006. 
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Estimated  value  of  Plan:$20,000  to  $50, 000. 35 


Solute  Consulting 

Founded  in  2002,  Solute  is  a  young  company  whose  principals  and 
employees  possess  a  strong  history  of  contract  support  to  the  US  Navy, 
extensive  operational  military  experience  and  a  wealth  of  technical  expertise 
that  will  be  leveraged  to  offer  our  customers  a  unique  skill-set.  Solute’s  team 
of  consultants  has  considerable  experience  supporting  the  US  Navy  both 
directly  and  as  Prime  Contractors  in  a  variety  of  projects. 

The  mission  of  all  members  of  the  Solute  Consulting  team  is  to  be  the 
premier  Network  Centric  consulting  firm  in  the  world.  All  of  our  team 
members  strive  to  provide  our  clients  with  unsurpassed  expertise  in  all 
aspects  of  Network  Centric  Warfare  and  Information  and  Knowledge 
Management,  as  well  as  mapping  the  information  flow  and  the 
implementation  of  Collaborative  Tools  in  a  tactical  environment. 

Combining  technical  expertise  and  vast  military  and  tactical  experience, 
Solute  Consulting  profoundly  enhances  the  Warfighters  ability  to  gather  and 
manage  information  in  a  networked,  collaborative  environment. 
(http://www.solute.us) 

Estimated  value  of  Plan:  $15,000  to  $25, 000. 36 


For  this  research,  the  mean  value  of  the  lowest  and  highest  estimates, 
$28,750,  is  used  as  the  market-comparable  value  of  the  planning  process  output. 


D.  KVA  ANALYSIS  OF  THE  “AS-IS”  PLANNING  PROCESS 

1.  Determining  the  Revenue  Generated  by  Subprocesses 

The  method  used  to  establish  estimates  of  the  knowledge  resident  in  the  C2F 
Planning  Process  was  the  Learning  Time  Approach.  Through  interviews  with  subject  matter 
experts  resident  in  the  C2F  FOPs,  the  processes  within  the  planning  process  were  agreed 
upon  as  described  above,  with  boundaries  established  between  the  subprocesses  in  order  to 
utilize  the  KVA  methodology  and  to  establish  a  valuation  of  each  subprocess. 

Throughout  the  TW  05  experiment,  planning  cell  members  were  surveyed  to 
detennine  the  knowledge  incorporated  in  a  particular  phase  of  planning.  To  determine  the 

35  L.  Zimmer.  Telephone  conversation  with  Linda  Zimmer  on  25  January  2006. 

36  A.  Blocksidge.  Email  with  Andrew  Blocksidge,  30  January  2006. 
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knowledge  inherent  in  a  particular  planning  phase  action,  the  staff  members  were  asked 
questions  regarding  how  long  they  required  to  leam  how  to  produce  the  outputs  they 
generated  and  how  long  it  would  require  a  “competent”  0-5  officer  to  leam  the  skills  to 
generate  the  same  output.  The  staff  members  were  to  assume  that  the  officer  in  question 
was  from  their  respective  service  (US  Army  Lieutenant  Colonel,  US  Air  Force  Lieutenant 
Colonel,  US  Marine  Corps  Lieutenant  Colonel,  or  US  Navy  Commander)  and  was  from  a 
line  position  (infantry,  aviator,  surface  warfare).  These  responses  were  determined  to  be 
unusable  for  analysis  due  to  the  inherent  biases  of  the  staff  members.  To  compensate  for 
these  biases,  the  “Normalized  Learning  Time”  method  was  used.  This  method,  although  it 
does  not  utilize  real  learning  times  to  determine  the  relative  learning  times,  it  does  capture 
the  relative  learning  time  for  the  subprocesses  effectively. 

In  order  to  detennine  relative  learning  times,  after  completion  of  the  TW  05  scenario 
select  members  of  the  FOPs  staff  were  surveyed  as  subject  matter  experts  to  determine 
which  subprocesses  of  the  planning  process  required  to  most  knowledge  to  produce.  The 
staff  members  were  asked,  “Given  100  days  of  training  time,  how  much  should  be  spent  by 
the  competent  0-5  baseline  officer  learning  each  subprocess?”  Table  3  presents  the  results 
of  this  survey: 


Intelligence  Planner 

OPT  Leader 

Ground  Fires 
Planner 

Normalized  Learning  Time  Values 
Used  for  KVA  Analysis  (Average 
of  OPT  Leader  and  Ground  Fires 
Planner) 

Time  Spent  to  Learn 
Subprocess  (days) 

Time  Spent  to  Learn 
Subprocess  (days) 

Time  Spent  to  Learn 
Subprocess  (days) 

Time  Spent  to  Learn  Subprocess 
(days) 

Mission 

Analysis 

20 

20 

10 

15 

COA 

Development 

15 

20 

20 

20 

COA  Analysis 

30 

15 

20 

17.5 

COA 

Selection 

10 

10 

10 

10 

ConOps 

Development 

15 

30 

30 

30 

ConOps 

Approval 

10 

5 

10 

7.5 

Table  3.  Normalized  Learning  Time  Survey  Results 


A  statistical  analysis  of  the  Normalized  Learning  Times  as  determined  by  the  three 


members  of  the  FOPs  staff  found  that  a  79.3%  correlation  exists  between  the  Nonnalized 
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Learning  Times  offered  by  the  OPT  Leader  and  the  Ground  Fires  Planner.  This  high 
correlation  lends  credibility  to  these  survey  results  and,  thus  the  average  of  these  two  serves 
as  the  Normalized  Learning  Times  for  the  subprocesses  for  this  analysis. 

To  attribute  revenue  to  the  subprocesses  of  the  overall  process,  the  relative  amount 
of  the  knowledge  applied  to  create  the  process  output  by  each  subprocess  must  be 
detennined.  To  estimate  the  knowledge  added  by  a  subprocess,  the  Normalized  Learning 
Times  presented  in  the  table  above  is  multiplied  by  the  number  of  actors  that  are  interacting 
with  the  subprocess  input  to  generate  the  subprocess  output.  For  example,  Mission  Analysis 
has  a  Normalized  Learning  Time  of  15  days  and  the  subprocess  is  conducted  by  two  staff 
members  (FOPs  Ground  Planner  and  FOPs  Intel  Planner).  Therefore,  the  knowledge  added 
in  the  subprocess  is  30  days.  This  method  of  detennining  knowledge  added  by  each 
subprocess  is  conducted  for  each  subprocess  and  the  results  added  to  detennine  the  total 
knowledge  added  throughout  the  overall  planning  process.  Following  the  determination  of 
knowledge  value  added  in  the  overall  planning  process  the  relative  knowledge  value  added 
by  each  subprocess  relative  to  the  overall  process  is  determined  as  a  percentage.  This 
relative  knowledge  value  added  (as  a  percentage  of  the  total  process  knowledge)  is  then 
multiplied  by  the  market  comparable  value  of  the  overall  process  output  to  determine  the 
value  of  each  subprocess. 

Table  4  shows  the  calculations  for  the  value  attributed  to  each  subprocess  and  the 
overall  planning  process: 
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Process 

Actors 

Knowledge 
(Normalized 
Learning  Time) 

Total 

Knowledge 

For 

Subprocess 

%  of  Total 
Knowledge 

Value 
Attributed 
to  Process 

Mission  Analysis 

30 

5.85% 

$1,682.93 

Ground  Planner 

15 

Intel  Planner 

15 

COA  Development 

120 

23.41% 

$6,731.71 

OPT  Leader 

20 

IO  Planner 

20 

SOF  Planner 

20 

MEU  XO 

20 

MEU  Planner  (S-2A) 

20 

MEU  Planner  (S-6A) 

20 

COA  Analysis 

157.5 

30.73% 

$8,835.37 

OPT  Leader 

17.5 

Intel  Planner 

17.5 

Ground  Planner 

17.5 

Ground  Fires  Planner 

17.5 

IO  Planner 

17.5 

SOF  Planner 

17.5 

CFMCC  Fires  Planner 

17.5 

MEU  XO 

17.5 

ESG  Planner 

17.5 

COA  Selection 

70 

13.66% 

$3,926.83 

CFMCC 

10 

CFMCC  OpsO 

10 

MEU  XO 

10 

ESG  Commander 

10 

FOPsO 

10 

OPT  Leader 

10 

CFMCC  Fires  Planner 

10 

ConOps  Development 

90 

17.56% 

$5,048.78 

MEU  XO 

30 

MEU  Planner  (S-2A) 

30 

MEU  Planner  (S-6A) 

30 

ConOps  Approval 

45 

8.78% 

$2,524.39 

CFMCC 

7.5 

CFMCC  OpsO 

7.5 

MEU  XO 

7.5 

ESG  Commander 

7.5 

FOPsO 

7.5 

OPT  Leader 

7.5 

Total  for  Planning  Process 

512.5 

512.5 

100.00% 

$28,750.00 

Table  4. 


Val 


ue  Attributed  to  “As-Is”  Subprocesses  and  Planning  Process 
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2.  Determining  Process  and  Subprocess  Costs 

Table  5  demonstrates  the  time  required  to  complete  the  phases  of  the  planning 
process  for  the  development  of  this  ConOps: 


Process 

Actors 

Cost  per 
manhour 

Touch  Time 
(Hours) 

Total  Manpower 
Cost 

%  of  Total 
Actual  Cost 

Mission  Analysis 

$961.74 

24.62% 

Ground  Planner 

$44.62 

4 

$178.47 

Intel  Analyst 

$48.95 

16 

$783.27 

COA  Development 

$1,159.22 

29.67% 

OPT  Leader 

$48.95 

1 

$48.95 

10  Planner 

$51.13 

4 

$204.51 

SOF  Planner 

$38.94 

4 

$155.78 

MEU  XO 

$56.28 

6 

$337.68 

MEU  Planner  (S-2A) 

$37.46 

6 

$224.73 

MEU  Planner  (S-6A) 

$31.26 

6 

$187.57 

COA  Analysis 

$584.92 

14.97% 

OPT  Leader 

$48.95 

1.42 

$69.52 

Intel  Analyst 

$48.95 

1.42 

$69.52 

Ground  Planner 

$44.62 

1.42 

$63.36 

Ground  Fires  Planner 

$41.29 

1.42 

$58.63 

10  Planner 

$51.13 

1.42 

$72.60 

SOF  Planner 

$38.94 

1.42 

$55.30 

CFMCC  Fires  Planner 

$43.98 

1.42 

$62.46 

MEU  XO 

$56.28 

1.42 

$79.92 

ESG  Planner 

$43.98 

1.42 

$53.63 

COA  Selection 

$232.45 

5.95% 

CFMCC 

$69.15 

0.6 

$41.49 

CFMCC  OpsO 

$59.50 

0.6 

$35.70 

MEU  XO 

$56.28 

0.6 

$33.77 

ESG  Commander 

$59.50 

0.6 

$35.70 

FOPsO 

$50.05 

0.6 

$30.03 

OPT  Leader 

$48.95 

0.6 

$29.37 

CFMCC  Fires  Planner 

$43.98 

0.6 

$26.39 

ConOps  Development 

$624.98 

16.00% 

MEU  XO 

$56.28 

5 

$281.40 

MEU  Planner  (S-2A) 

$37.46 

5 

$187.28 

MEU  Planner  (S-6A) 

$31.26 

5 

$156.31 

ConOps  Approval 

$343.43 

8.79% 

CFMCC 

$69.15 

1 

$69.15 

CFMCC  OpsO 

$59.50 

1 

$59.50 

MEU  XO 

$56.28 

1 

$56.28 

ESG  Commander 

$59.50 

1 

$59.50 

FOPsO 

$50.05 

1 

$50.05 

OPT  Leader 

$48.95 

1 

$48.95 

Total  for  Planning 
Process  Iteration 

44.2 

$2,055.78 

100.00% 

Table  5.  Manpower  Costs  of  “As-Is”  Subprocesses  and  Planning  Process 
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3.  Determining  the  ROI  for  the  Process  and  Subprocesses 

The  resulting  analysis  provided  the  following  insights  into  the  ROI  of  the  human 
knowledge  that  was  required  to  develop  the  approved  ConOps  during  TW  05: 


Process 

Knowledge 

(K)  ‘ 

(%  of  total) 

Value 

Produced  By 
Process 
(V) 

Manpower 
Cost  of 
Process 
(C) 

ROI 

([V-C]/C  x  100%) 

Mission 

Analysis 

5.85 

$1682.93 

$961.74 

74.99% 

COA 

Development 

23.41 

$6,731.71 

$1,159.22 

480.71% 

COA  Analysis 

30.73 

$8,835.37 

$584.92 

1410.52% 

COA  Approval 

13.66 

$3926.83 

$232.45 

1589.33% 

ConOps 

Development 

17.56 

$5,048.78 

$624.98 

707.83% 

ConOps 

Approval 

8.78 

$2,524.39 

$343.43 

635.05% 

Planning 
Process  Total 

100 

$28,750.00 

$3,906.75 

635.91% 

Table  6.  ROI  of  “As-Is”  Subprocesses  and  the  Planning  Process 


E.  “TO-BE”  PLANNING  PROCESS 

This  scenario  describes  the  JFMCC  Planning  Process  aided  with  the  developmental 
IT  presented  in  Chapter  II.  The  IT  systems  noted  (CoRaven,  Weasel,  and  Fox)  are  systems 
that  were  under  development  for  the  US  Army  Research  Laboratory,  and  thus  were  focused 
on  military  planning  in  a  land  warfare  environment.  In  this  scenario,  it  is  assumed  that  the 
systems  developed  are  capable  of  modification  to  aid  in  the  planning  of  a  naval  forces 
scenario. 

1.  The  Cost  of  IT 

The  estimated  cost  of  the  CoRaven,  Weasel,  Fox  suite  of  decision  support  tools  is 
not  readily  available  for  this  research  for  various  reasons.  Key  among  these  is  the  fact  that 
the  funding  for  the  suite  of  tools  was  provided  by  the  Anny  Research  Laboratory  to  multiple 
organizations,  particularly  academic  institutions.  At  these  institutions,  the  students  who  did 

much  of  the  programming  did  not  receive  direct  compensation  for  the  work  involved  with 
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development  of  the  systems  and,  therefore,  did  not  maintain  records  of  work  consistently. 
Therefore,  for  this  research  an  estimated  per  unit  price  is  derived  from  commercial  products 
that  incorporate  similar  technologies.  For  the  CoRaven,  Weasel,  and  Fox  systems,  the 
highest  purchase  prices  of  a  comparable  commercial  product  will  be  used  to  provide  the 
most  conservative  calculations  in  the  KVA  analysis  of  the  notional  process. 

The  fundamental  logic  underlying  the  CoRaven  systems  programming  is  Bayesian 
Networks.  Three  commercially  available  software  tools  were  identified  as  decision  support 
tools  that  use  Bayesian  Networks  as  their  foundation.  These  three  programs  are  Bayesia 
Lab  Version  4.037,  Hugin  Explorer38,  and  Agena  Risk39.  The  purchase  prices  of  these 
products  vary  greatly,  at  $51,210.70,  $4,336.65  and  $1,895.09.  For  this  research  the  highest 
purchase  price  of  $51,210.70  will  serve  as  the  estimated  purchase  price  for  the  CoRaven 
tool.  Assuming  a  product  lifespan  of  five  years,  this  calculates  to  a  per  year  cost  of 
$10,242.14.  For  this  research,  it  is  assumed  that  the  naval  command  using  the  tool  will 
deploy  for  six  months  every  year,  thus  a  weekly  ownership  cost  of  $393.93  is  estimated. 
Based  upon  the  Trident  Warrior  experiment,  it  is  assumed  that  the  planning  staff  will 
generate  one  plan  a  week. 

The  fundamental  logics  underlying  the  Weasel  and  Fox  systems  are  genetic 
algorithm  and  combinations  and  permutations  of  the  capabilities  and  rules  selected  by  the 
human  operator.  A  survey  of  commercially  available  DSSs  was  conducted  and  three  tools 
were  identified  as  having  similar  logic:  AI  Trilogy  ($1,245.00)40,  Palisade  Risk  Optimizer 

37  BayesiaLab  Version  4.0  is  a  product  developed  by  Bayesia  SA  of  Laval  Cedex,  France.  The  purchase 
price  of  BayesiaLab  v.  4.0  Professional  Edition  with  Technical  Support  was  used  for  determining  purchase 
cost  of  the  software.  The  purchase  price  of  39,600  Euros  was  converted  to  US  Dollars  using  a  conversion  rate 
of  1.29319  US  Dollars  per  Euro.  Further  information  regarding  the  BayesiaLab  product  and  Bayesia  S/A  is 
available  at  http://www.bayesia.com.  Retrieved  May  2006. 

38  Flugin  Explorer  is  a  product  developed  by  Flugin  Expert  A/S  of  Aalborg,  Denmark.  The  purchase  price 
of  24,995  Danish  Krones  was  converted  to  US  Dollars  using  a  conversion  rate  of  5.7637  Danish  Krones  to  US 
Dollar.  Further  information  regarding  the  Flugin  Explorer  and  Flugin  Expect  S/A  is  available  at 
http://www.hugin.com/.  Retrieved  May  2006. 

39  Agena  Risk  is  a  product  developed  by  Agena  Limited  of  London,  United  Kingdom.  The  purchase  price 
of  1000  British  Pounds  was  converted  to  US  Dollars  using  a  conversion  rate  of  1.895.09  US  Dollars  to  British 
Pound.  Further  information  regarding  the  Agena  Risk  product  and  Agena  Limited  is  available  at 
http://www.agena.co.uk.  Retrieved  May  2006. 

40  AI  Trilogy  is  a  product  developed  by  Ward  Systems  Group,  Inc.  of  Frederick,  MD.  Further 
information  regarding  AI  Trilogy  and  Ward  Systems  Group,  Inc  is  available  http://www.wardsystems.com. 
Retrieved  May  2006. 
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Industrial  Version  ($  1, 195.00)41,  and  Discipulus  Professional  Edition  ($495)42.  The  highest 
purchase  price  of  $1,245.00  is  estimated  as  the  purchase  price  for  both  the  Weasel  and  Fox 
systems.  Assuming  a  five  year  lifespan  of  the  tool  and  the  above  stated  deployment  cycle, 
the  weekly  ownership  cost  of  the  decision  support  tools  is  calculated  as  $9.58  per  tool. 

2.  The  Reengineered  Planning  Process 

The  primary  change  from  the  “as-is”  current  planning  process  to  the  “to-be” 
planning  process  is  the  introduction  of  the  CoRaven,  Weasel,  and  Fox  suite  of  decision 
support  tools.  The  introduction  of  these  systems  will  significantly  affect  the  Mission 
Analysis,  COA  Development,  and  COA  Comparison  subprocesses. 

During  the  Mission  Analysis  subprocess,  the  Intelligence  Analyst  dedicated  the  bulk 
of  the  time  finding,  collecting,  and  preparing  for  presentation  information  regarding  the 
enemy  forces  and  the  surrounding  battlespace.  With  the  addition  of  the  CoRaven  and 
Weasel  systems  as  an  aid  to  the  Mission  Analysis  process,  the  Intelligence  Analyst  will 
input  the  decision  making  logic,  in  the  form  of  a  logic  tree  during  predeployment  periods  or 
during  periods  of  calm.  The  CoRaven  system  will  generate  probabilities  of  likely  enemy 
actions  and  automatically  transfer  data  to  the  Weasel  system  for  enemy  COA  generation. 
With  the  enemy  data  transferred  to  the  Weasel  system,  the  Intelligence  Analyst  would  select 
basic  assumptions  through  the  graphical  interface.  Then  the  Weasel  system  will  generate 
the  set  of  potential  enemy  COAs.  From  this  set  of  enemy  COAs  the  Intelligence  Analyst 
will  select  those  which  he  detennines  to  be  the  most  relevant  to  the  situation  by  which 
friendly  COAs  will  be  compared.  For  this  research  it  is  assumed  that  the  time  required  to 
execute  the  Mission  Analysis  tasks  performed  by  the  Intelligence  Analyst  will  be  25%  of 
that  currently  required  in  the  planning  process.  It  is  also  assumed  that  50%  of  the 
knowledge  required  by  the  Intelligence  Analyst  to  complete  the  Mission  Analysis  tasks  will 
be  resident  in  the  IT  systems. 

With  the  implementation  of  the  DSS  Suite,  the  human  labor  required  to  develop  and 
compare  potential  friendly  COAs  against  the  expected  enemy  COAs  will  be  significantly 

41  Risk  Optimizer  is  an  add-in  developed  for  use  with  the  Microsoft  Excel  program  by  the  Palisades 
Corporation  of  Ithaca,  NY.  Futher  information  regarding  Risk  Optimizer  and  the  Palisades  Corporation  is 
available  at  http://www.palisade.com.  Retrieved  May  2006. 

42  Discipulus  is  a  product  developed  by  Register  Machine  Learning  Technologies,  Incorporated  of 
Littleton,  CO.  Further  information  regarding  the  Discipulus  product  and  RML  Technologies,  Inc.  is  available 
at  http://www.aimlearning.com.  Retrieved  May  2006. 
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reduced.  The  potential  enemy  COAs  deemed  most  significant  to  the  commander  and  the 
planning  staff  (during  the  Mission  Analysis  subprocess)  will  be  transferred  automatically 
from  the  Weasel  system  to  the  Fox  system.  The  Fox  system  will  then  generate  the  potential 
friendly  COAs  for  the  staff  based  on  inputted  data  (such  as  organization,  terrain  constraints, 
stated  constraints  and  restraints,  etc.)  and  will  also  run  the  combat  simulator  to  detennine 
the  fitness  of  each  COA  against  the  set  of  potential  enemy  COAs.  With  the  implementation 
of  the  Fox  system,  the  two  distinct  subprocesses  of  COA  Development  and  COA  Analysis 
will  be  combined  into  a  single  subprocess.  It  is  assumed  that  the  COA 
Development/Analysis  process  aided  by  the  Fox  DSS  will  require  one  hour.  It  is  also 
assumed  that  75%  of  the  knowledge  required  to  accomplish  the  current  COA  Development 
and  COA  Analysis  tasks  will  be  resident  in  the  Fox  DSS. 

Based  upon  the  SME  opinion,  anecdotal  information  claims  that  the  quality  of  the 
products  produced  with  the  aid  of  the  CoRaven,  Weasel  and  Fox  systems  are  at  least  as 
good  as  those  produced  without  the  systems.  However,  since  the  information  does  not 
provide  conclusive  evidence  it  is  assumed  for  this  research  that  the  value  of  the  process 
output  for  the  “to-be”  reengineered  process  is  the  same  as  that  of  the  “as-is”  process.43 


F.  KVA  ANALYSIS  OF  THE  “TO-BE”  PROCESS 

The  following  KVA  analysis  is  provided  to  determine  the  change  in  the  ROI  of  the 
planning  process  and  the  subprocesses  with  the  introduction  of  the  DSS  suite  to  aid  the 
process.  The  analysis  will  also  provide  a  ROI  for  the  infonnation  technology  based  upon 
the  estimates  and  assumptions  presented  above. 

1.  Determining  the  Value  of  the  “To-Be”  Process  IT 

To  detennine  the  value  of  the  decision  support  tools  provided  by  the  notional  IT,  the 
value  of  subprocess  outputs  and  the  planning  process  output  are  assumed  to  be  unchanged 
from  the  current  process.  The  value  of  the  output  of  the  “to-be”  COA 
Development/ Analysis  subprocess  is  assumed  to  be  the  sum  of  the  values  of  the  current 
COA  Development  and  COA  Analysis  subprocesses.  Table  7  demonstrates  the  value  which 
is  attributed  to  the  human  actors  and  the  decision  support  tools  in  the  “to-be”  subprocesses 

43  Per  phone  conversation  with  Professor  Caroline  Hayes  at  the  University  of  Minnesota  on  26  April 
2006. 
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affected  by  the  introduction  of  the  DSS  suite.  All  other  subprocess  are  assumed  to  be 
unaffected  by  the  DSS  suite  and  therefore  are  excluded  from  Table  7. 


Process 

Actor/Asset 

Total  Knowledge  For 

Subprocess 

(Learning  Time) 

%  of  Subprocess 

Knowledge 

Attributed  to  Process 

Asset 

%  of  Total 

Process 

Knowledge 

Value  Attributed  to 

Subprocess  and 

Actor/Asset 

Mission  Analysis 

30 

5.85% 

$1,682.93 

Human  Actors 

22.5 

75% 

4.39% 

$1,262.20 

CoRaven/ 

Weasel  tools 

7.5 

25% 

1 .46% 

$420.73 

COA 

Development/Analysis 

227.5 

54.15% 

$15,567.07 

Human  Actors 

69.4 

25% 

13.54% 

$3,891.77 

Fox  tool 

208.1 

75% 

40.61% 

$11,675.30 

Table  7.  Val 

lue  Attributed  to  IT  in  “To-Be”  Process 

2.  Determining  “To-Be”  Process  and  Subprocess  Costs 

Table  8  demonstrates  the  costs  of  the  human  actors  and  IT  associated  with  the  “to- 
be”  planning  process. 
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Process 

Actors 

Cost  per 
manhour 

Touch  Time 
(Hours) 

Total  Manpower 
Cost 

IT  Cost 
(Weekly  Cost) 

Total  Cost 

%  of  Total 
Actual  Cost 

Mission  Analysis 

$374.29 

$403.51 

$777.79 

31.50% 

Ground  Planner 

$44.62 

4 

$178.47 

Intel  Analyst 

$48.95 

4 

$195.82 

COA  Development/ 
Analysis 

$480.63 

$9.58 

$490.21 

19.86% 

OPT  Leader 

$48.95 

1 

$48.95 

Intel  Analyst 

$48.95 

1 

$48.95 

IO  Planner 

$51.13 

1 

$51.13 

SOF  Planner 

$38.94 

1 

$38.94 

Ground  Planner 

$44.62 

1 

$44.62 

MEUXO 

$56.28 

1 

$56.28 

MEU  Planner  (S-2A) 

$37.46 

1 

$37.46 

MEU  Planner  (S-6A) 

$31.26 

1 

$31.26 

Ground  Fires  Planner 

$41.29 

1 

$41.29 

CFMCC  Fires  Planner 

$43.98 

1 

$43.98 

ESG  Planner 

$37.76 

1 

$37.76 

COA  Selection 

$232.45 

$232.45 

9.42% 

CFMCC 

$69.15 

0.6 

$41.49 

CFMCC  OpsO 

$59.50 

0.6 

$35.70 

MEUXO 

$56.28 

0.6 

$33.77 

ESG  Commander 

$59.50 

0.6 

$35.70 

FOPsO 

$50.05 

0.6 

$30.03 

OPT  Leader 

$48.95 

0.6 

$29.37 

CFMCC  Fires  Planner 

$43.98 

0.6 

$26.39 

ConOps  Development 

$624.98 

$624.98 

25.31% 

MEUXO 

$56.28 

5 

$281.40 

MEU  Planner  (S-2A) 

$37.46 

5 

$187.28 

MEU  Planner  (S-6A) 

$31.26 

5 

$156.31 

ConOps  Approval 

$343.43 

$343.43 

13.91% 

CFMCC 

$69.15 

1 

$69.15 

CFMCC  OpsO 

$59.50 

1 

$59.50 

MEUXO 

$56.28 

1 

$56.28 

ESG  Commander 

$59.50 

1 

$59.50 

FOPsO 

$50.05 

1 

$50.05 

OPT  Leader 

$48.95 

1 

$48.95 

Total  for  Planning 
Process  Iteration 

44.2 

$2,055.78 

$413.08 

$2,468.87 

100.00% 

Table  8. 


Manpower  and  IT  Costs  Associated  with  “To-Be”  P 


aiming  Process 
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3.  Determining  ROI  for  “To-Be”  Process  and  Subprocess 

Table  9  presents  the  ROI  of  the  “to-be”  planning  process  and  subprocesses. 


Process 

Knowledge 

(K) 

(%  of  total) 

Value  Attributed  to  Process 

(V) 

Costs  Associated  to 
Process 

(C) 

ROI 

([V-C]/C  x  100%) 

Mission  Analysis 

5.85 

$1,682.93 

$777.79 

116.37% 

COA  Development/ 
Analysis 

54.15 

$15,567.07 

$490.21 

3075.59% 

COA  Approval 

13.66 

$3,926.83 

$232.45 

1589.33% 

ConOps 

Development 

17.56 

$5,048.78 

$624.98 

707.83% 

ConOps  Approval 

8.78 

$2,524.39 

$343.43 

635.05% 

Planning  Process 

Total 

100.00 

$28,750 

$2,468.87 

1064.5% 

Table  9.  ROI  of  “To-Be”  Process  and  Subprocesses 


4.  Determining  ROI  of  Information  Technology 

To  detennine  the  ROI  for  the  notional  DSS  suite,  the  value  (see  Table  7)  and  costs 
(see  Table  8)  associated  with  the  decision  support  tools  from  the  above  analysis  are  used  in 
the  traditional  ROI  fonnula.  The  total  revenue  attributed  to  the  DSS  suite  is  $12,096.03. 
The  total  cost  associated  with  the  DSS  suite  is  $413.08. 


($12, 096.03 -$413.08) 
$413.08 


x  100%  =  2828.25% 


This  calculated  ROI  states  that  for  every  $1  invested  in  the  acquisition  of  the 
notional  DSS  suite,  $28.28  are  returned. 
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G.  COMPARISION  OF  THE  “AS-IS”  AND  “TO-BE”  PROCESSES 

The  following  figures  and  tables  demonstrate  the  resulting  changes  in  execution 
time,  the  change  in  cost,  and  the  change  in  the  ROI  associated  with  the  introduction  of  the 
notional  DSS  suite  to  the  JFMCC  Planning  Process.  Figure  7  compares  the  execution  time 
required  for  the  “as-is”  and  “to-be”  planning  processes. 


With  the  introduction  of  the  automated  systems,  the  time  required  to  execute  the 
Mission  Analysis  and  COA  Development  and  Analysis  are  reduced  to  25%  and  13.5%  of 
the  “as-is”  subprocesses.  In  the  notional  “to-be”  process,  execution  time  is  reduced  to 
38.6%  of  the  current  requirement. 


44  Execution  time  is  determined  as  the  maximum  “touch  time”  required  for  a  subprocess.  The  execution 
time  for  the  “as-is”  COA  Development/ Analysis  is  the  sum  of  the  time  required  of  the  two  distinct 
subprocesses  of  “COA  Development”  and  “COA  Analysis.” 
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Figure  8  shows  graphically  the  cost  differences  between  the  “as-is”  planning  process 
and  the  “to-be”  planning  process. 
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Figure  8.  Cost  Comparison  of  the  “As-ls”  and  “To-Be”  Process45 


In  the  “to-be”  JFMCC  Planning  Process  the  cost  associated  with  Mission  Analysis  is 
reduced  to  80%  of  the  “as-is”  subprocess,  COA  Development/ Analysis  costs  are  reduced  to 
28%  of  the  current  subprocess,  and  the  entire  planning  process  costs  are  reduced  to  63%  of 
the  “as-is”  process. 


45  Costs  associated  with  the  “as-is”  COA  Development/ Analysis  is  the  sum  of  the  two  distinct 
subprocesses  of  the  “as-is”  planning  process.  Costs  of  the  “to-be”  process  include  both  manpower  and  IT 
costs. 


47 


Figure  9  demonstrates  the  affects  of  the  introduction  on  the  notional  DSS  and 
process  reengineering  on  the  ROI  values  of  the  subprocesses  and  the  planning  process. 


Figure  9.  ROI  Comparison  of  the  “As-Is”  and  “To-Be”  Planning  Process 


With  the  introduction  of  the  decision  support  tools  to  the  JFMCC  Planning  Process, 
the  ROI  values  of  the  Mission  Analysis  and  COA  Development/ Analysis  41%  and  2283%, 
respectively.  The  overall  process  ROI  is  improved  by  429%. 


48 


V.  CONCLUSIONS  AND  RECOMMENDATIONS 


A.  RESEARCH  LIMITATIONS 

This  Proof  of  Concept  was  generated  using  subject  matter  expert  input  and 
observations  from  one  execution  of  the  JFMCC  Planning  Process  during  TW  05  experiment. 
Therefore,  the  data  presented  in  this  research  can  not  be  assumed  to  be  accurate  for  all 
possible  scenarios.  Additionally,  given  exercise  restrictions,  entire  staff  planners  from  the 
IWO  JIMA  Strike  Group  and  the  24th  Marine  Expeditionary  Unit  were  not  available; 
therefore  the  calculations  presented  were  based  solely  on  available  data  with  the  limited 
staffs  participating  in  TW  05.  The  JFMCC  Planning  Process,  as  prescribed  in  NWDC 
TACMEMO  3-32-03,  was  recently  adopted  by  the  Second  Fleet  staff  prior  to  the  TW  05 
experiment.  Therefore,  procedures  and  policies  relating  to  the  planning  process  may  have 
been  evolving  during  execution.  More  accurate  calculations  could  be  made  of  the  planning 
process  through  observation  in  actual  operations  during  a  deployment  period. 

Likewise,  the  CoRaven,  Weasel,  and  Fox  DSS  tools  were  developed  for  use  in  a 
ground  conflict  scenario,  with  opposing  annies  battling  using  conventional  tactics.  The 
tools  do  not  currently  have  function  in  naval  warfare  environments,  nor  do  they  possess  the 
capability  to  look  at  potential  COAs  that  include  non-kinetic  warfare  or  asymmetric  threats. 
The  systems  are  introduced  to  illustrate  the  potential  of  IT  to  support  the  planning  process. 
The  cost  associated  with  this  IT  is  an  estimate,  based  upon  a  survey  of  currently  available 
commercial  products.  This  survey  of  commercial  products  identified  products  with  similar 
underlying  logics,  not  necessarily  similar  functionality.  A  custom  DSS  suite  developed 
specifically  for  the  Department  of  the  Navy  may  cost  considerably  more  or  less. 

B.  RESEARCH  QUESTIONS 

The  KVA  Analysis  of  the  current  JFMCC  Planning  Process  reveals  that  the  process 
inefficiencies  are  most  significant  in  the  Mission  Analysis  and  COA  Development 
subprocesses.  These  subprocesses  therefore  represent  the  facets  of  the  planning  process 
with  the  greatest  potential  for  improvement  through  the  application  of  IT  systems.  Decision 
support  tools  of  similar  capability  as  the  CoRaven,  Weasel,  and  Fox  systems  will  likely 


49 


provide  significant  improvement  to  the  planning  process  through  automation  of  portions  of 
these  subprocesses.  The  improvements  to  the  process  through  automation  will  be  most 
readily  quantified  in  terms  of  improvement  in  planning  time  requirements,  cost  savings,  and 
improved  efficiency  as  measured  in  tenns  of  ROI. 

1.  Planning  Time 

Among  the  key  capabilities  required  for  the  implementation  of  the  FORCEnet 
Functional  Concept  is  to  provide  decision  makers  the  ability  to  make  and  implement  good 
decisions  quickly.  Through  the  adoption  of  IT,  such  as  the  DSSs  identified  in  this  research, 
the  time  required  to  plan  military  operations  would  be  decreased  by  61.4%.  While  this 
improvement  is  specific  to  the  planning  of  an  operation,  the  residual  effects  would  allow  for 
execution  of  the  assigned  mission  more  quickly. 

2.  Cost  Savings 

The  manpower  cost  associated  with  planning  present  the  most  quantifiable 
advantage  of  the  adoption  of  IT  systems  to  support  the  JFMCC  Planning  Process.  With  the 
implementation  of  the  DSSs  presented  in  this  research,  it  is  projected  that  the  over-all  cost 
of  generating  the  plan  would  decrease  by  37%  to  include  the  cost  associated  with  the  IT 
systems. 

3.  Improved  ROI 

The  ROI  of  the  overall  JFMCC  Planning  Process  was  markedly  improved  from  the 
current  process  to  the  “to-be”  process.  With  the  introduction  of  the  notional  DSS  suite  to 
aid  the  planning  process,  an  ROI  improvement  for  the  overall  process  of  429%  is  projected. 


C.  RECOMMENDATIONS  TO  THE  US  NAVY 

The  JFMCC  Planning  Process  was  only  recently  formalized  with  the  publication  of 
NWDC  TACMEMO  3-32-03  and  the  implementation  on  the  operational  Navy  Fleet 
continues.  The  JFMCC  Planning  Process,  as  executed  during  Trident  Warrior  05,  does  not 
take  advantage  of  IT  as  a  tool  to  improve  the  process  or  the  product  of  the  planning.  The 
leadership  of  the  US  Navy  must  take  the  initiative  to  bring  IT  capabilities  to  this  most 
critical  of  decision-making  functions  for  the  FORCEnet  Functional  Concept  to  be  realized. 

Through  the  development  and  adoption  of  DSSs  to  aid  the  planning  process,  with 


similar  capabilities  to  those  provided  by  the  CoRaven,  Weasel,  and  Fox  systems,  the  effects 
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of  the  process  improvement  will  be  significant.  Through  the  decreased  labor  required  in 
plan  generation,  the  human  actors  currently  employed  in  lower-level  command  and  control 
functions  will  be  able  to  dedicate  themselves  to  higher-level  functions  that  require  more 
judgment  and  insight  that  only  the  human  can  provide.  Likewise,  the  ability  of  a  planning 
staff  to  generate  a  plan  in  a  timelier  manner  will  allow  for  the  execution  of  the  operations  at 
a  faster  tempo.  This  will  leave  the  enemy  unbalanced  and  in  a  reactionary  mode  to  US 
actions. 

Investment  in  IT  systems,  just  as  any  other  investment,  always  carries  inherent  risk. 
The  costs  of  such  systems  will  be  significant  during  development  and  implementation  while 
the  returns  of  the  investment  will  be  only  realized  over  the  life  of  the  system.  Using  the 
KVA  methodology,  decision  makers  are  able  to  gain  insight  into  organizational  performance 
efficiencies  and  inefficiencies.  Using  the  analysis  methodology  to  evaluate  prospective 
investments,  the  decision  makers  are  equipped  with  risk  data  and  the  potential  value  of  these 
systems  to  aid  in  investment  decisions. 
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